-- Logs begin at Fri 2022-09-09 14:18:42 UTC, end at Fri 2022-09-09 15:13:47 UTC. -- Sep 09 14:48:43.517783 dv-cinder-828696-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 14:48:43.526504 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 14:48:43 2022] *** Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: nodename: dv-cinder-828696-11-iscsi Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: machine: x86_64 Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: clock source: unix Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: pcre jit disabled Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: detected number of CPU cores: 4 Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: current working directory: / Sep 09 14:48:43.528599 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: detected binary path: /usr/bin/uwsgi-core Sep 09 14:48:43.529376 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: your processes number limit is 47680 Sep 09 14:48:43.529376 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: your memory page size is 4096 bytes Sep 09 14:48:43.529376 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: detected max file descriptor number: 2048 Sep 09 14:48:43.529376 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: lock engine: pthread robust mutexes Sep 09 14:48:43.529376 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: thunder lock: enabled Sep 09 14:48:43.529376 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 14:48:43.529376 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 14:48:43.569009 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: Python main interpreter initialized at 0x5596b8e679c0 Sep 09 14:48:43.569009 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: python threads support enabled Sep 09 14:48:43.569009 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: your server socket listen backlog is limited to 100 connections Sep 09 14:48:43.569009 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: your mercy for graceful operations on workers is 90 seconds Sep 09 14:48:43.569436 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 14:48:43.569436 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: *** Operational MODE: preforking *** Sep 09 14:48:43.569714 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: *** uWSGI is running in multiple interpreter mode *** Sep 09 14:48:43.569714 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: spawned uWSGI master process (pid: 105419) Sep 09 14:48:43.569926 dv-cinder-828696-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 14:48:43.570693 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: spawned uWSGI worker 1 (pid: 105420, cores: 1) Sep 09 14:48:43.571948 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: spawned uWSGI worker 2 (pid: 105421, cores: 1) Sep 09 14:48:43.571948 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 14:48:44.224725 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 14:48:44.225333 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 14:48:45.300211 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:48:45.300211 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: from cryptography.utils import int_from_bytes Sep 09 14:48:45.300808 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:48:45.300808 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: from cryptography.utils import int_from_bytes Sep 09 14:48:45.301695 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:48:45.301695 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: from cryptography.utils import int_from_bytes Sep 09 14:48:45.302110 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:48:45.302110 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: from cryptography.utils import int_from_bytes Sep 09 14:48:47.774648 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 14:48:47.775301 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 14:48:47.775404 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 14:48:47.775762 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 14:48:47.775870 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 14:48:47.776216 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 14:48:47.776306 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 14:48:47.776397 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.776589 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 14:48:47.776685 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.776948 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 14:48:47.777044 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.777224 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 14:48:47.777354 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.777613 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.777716 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.777937 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.778031 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.778251 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.778348 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.778568 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.778654 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.778892 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.778987 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.779152 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.779240 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.779463 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.779550 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.779787 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828696-11-iscsi {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.779881 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.780106 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.780224 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.780373 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.780515 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.780687 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.780808 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.781005 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.781093 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828696-11-iscsi {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.781331 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.781434 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.782169 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.782277 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.782471 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.782566 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.782794 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.782961 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.783098 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.783410 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.783580 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.783730 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.783879 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.784042 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.784264 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.784432 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.784575 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.784714 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.784857 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.784997 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.785141 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.785309 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.785455 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.785593 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.785727 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.785864 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.786034 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.786143 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.786353 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.786548 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828696-11-iscsi {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.786659 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.786863 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.786983 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.787173 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.787291 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.787486 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.787686 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828696-11-iscsi {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.787896 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.787982 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.788207 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.788300 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.788514 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.788601 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.788833 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.788986 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.789154 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.789323 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.789490 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.789634 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.789815 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.789955 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.790131 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.790279 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.790449 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.790584 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.790767 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.790910 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.791068 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.791230 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.791376 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.791550 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.791682 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.791867 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.792000 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.792169 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.792304 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.792479 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.792610 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.792794 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.792879 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.793113 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.793231 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.793445 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.793530 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.793752 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.793849 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.794004 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.794102 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.794315 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.794407 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.794579 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.794665 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.794898 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.794991 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.795216 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.795310 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.795494 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.795645 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.795737 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.795824 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.796051 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.796151 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.796374 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.796479 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.796684 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.796770 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.796994 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.797090 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.797871 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.798008 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.798187 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.798283 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.798497 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.798592 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.798807 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.798908 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.799115 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.799202 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.799423 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.799507 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.799739 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.799838 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.800053 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.800139 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.800370 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.800462 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.800679 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.800786 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.800994 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.801081 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.801348 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.801454 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.801655 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.801749 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.801964 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.802059 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.802284 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.802378 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.802591 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.802679 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.802895 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.802988 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.803200 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.803286 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.803517 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.803613 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.803825 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.803918 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.804130 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.804237 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.804377 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.804473 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.804676 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.804763 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.804978 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.805077 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.805318 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.805420 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.805644 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.805780 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.805943 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.806086 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.806231 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.806318 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.806528 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.806614 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.806831 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.806941 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.807135 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.807228 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.807436 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.807529 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.807734 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.807829 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.808035 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.808119 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.808337 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.808430 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.808635 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.808723 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.808938 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.809030 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.809258 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.809360 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.809562 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.809647 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.809863 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.809960 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.810168 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.810255 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.810471 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.810566 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.810774 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.810880 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.811076 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.811164 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.811378 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.811473 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.811692 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.811778 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.811994 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.812078 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.812299 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.812394 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.812607 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.812695 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.812932 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.813032 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.813253 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.813344 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.813573 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.813660 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.813878 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.813975 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.814182 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.814278 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.814482 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.814575 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.814781 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.814866 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.815085 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.815178 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.815388 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.815473 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.815687 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.815782 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.815991 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.816080 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.816289 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.816384 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.816589 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.816689 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.816889 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.816982 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.817189 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.817313 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.817512 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.817606 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.817813 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.817945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.818109 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.818203 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.818409 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.818504 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.818710 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.818796 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.819012 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.819107 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.819309 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.819404 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.819606 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.819699 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.819922 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.820008 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.820228 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.820323 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.820534 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.820620 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.820840 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.820958 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.821179 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:48:47.821297 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.821541 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.821635 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.821872 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.821961 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.822190 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.822275 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.822501 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.822591 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.822814 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.822908 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.823139 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.823233 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.823451 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.823543 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.823761 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.823860 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.824070 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.824162 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.824387 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.824472 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.824697 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.824790 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.825010 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.825117 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.825344 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.825433 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.825658 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.825755 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.825978 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.826084 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.826287 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.826383 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.826603 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.826699 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.826918 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.827002 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.827234 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.827325 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.827541 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.827634 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.827860 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.827959 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.828191 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.828299 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.828530 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.828618 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.828843 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.828937 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.829162 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.829288 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.829499 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.829588 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.829807 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.829902 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.830116 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.830203 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.830461 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.830549 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.830773 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.830866 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.831082 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.831172 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.831392 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.831479 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.831702 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.831786 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.832023 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.832126 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.832335 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.832423 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.832644 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.832729 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.832953 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.833047 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.833287 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.833391 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.833597 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.833683 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.833907 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.834002 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.834222 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.834310 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.834542 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.834663 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.834853 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.834963 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.835163 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.835258 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.835481 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.835626 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.835844 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.836008 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.836140 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.836223 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.836397 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.836497 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.836700 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.836788 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.837003 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.837096 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.837330 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.837420 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.837641 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.837729 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.837945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.838029 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.838323 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.838422 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.838559 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.838647 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.838868 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.838953 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.839175 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.839268 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.839491 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.839584 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.839801 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.839888 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.840110 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.840212 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.840419 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.840505 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.840724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.840810 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.841040 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.841184 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.841367 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.841453 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.841672 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.841774 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.841976 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.842070 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.842291 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.842377 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.842595 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.842685 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.842900 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.842994 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.843206 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.843292 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.843512 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.843597 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.843819 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.843905 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.844639 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.844735 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.844951 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.845044 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.845280 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.845370 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.845786 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.845868 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.845954 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.846034 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.846197 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.846285 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.846509 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.846606 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.846817 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.846913 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.847142 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.847228 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.847446 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.847531 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.847756 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.847849 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.848082 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.848167 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.848403 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.848559 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.848696 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.848850 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.848995 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.849142 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.849320 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.849459 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.849595 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.849740 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.849897 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.850029 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.850205 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.850350 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.850508 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.850652 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.850812 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.850952 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.851113 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.851290 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.851443 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.851582 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.851722 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.851866 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.851999 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.852144 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.852288 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.852424 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.852557 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.852696 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.852864 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.853001 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.853173 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.853334 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.853513 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.853599 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.853821 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.853910 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.854127 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.854216 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.854432 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.854528 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.854775 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.854870 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.855107 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.855203 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.855395 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.855489 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.855708 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.855804 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.856016 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.856111 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.856328 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.856435 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.856639 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.856736 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.856949 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.857035 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.857279 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.857369 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.857588 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.857693 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.857898 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.857984 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.858201 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.858286 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.858520 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.858619 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.858826 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.858912 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.859142 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.859227 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.859442 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.859529 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.860305 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.860410 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.860635 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.860731 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.860958 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.861045 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.861296 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.861388 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.861613 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.861709 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.861954 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.862042 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.862273 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.862358 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.862580 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.862675 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.862892 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.862978 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.863203 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.863290 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.863512 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.863611 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.863818 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.863911 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.864125 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.864210 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.864432 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.864534 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.864736 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.864821 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.865051 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.865135 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.865383 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.865559 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.865699 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.865786 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.865999 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.866084 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.866310 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.866420 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.866618 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.866759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.866935 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.867031 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.867239 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.867340 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.867548 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.867649 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.867867 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.867953 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.868177 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.868278 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.868485 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.868579 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.868794 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.868885 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.869097 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.869193 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.869429 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.869517 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.869735 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.869821 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.870043 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.870131 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.870349 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.870437 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.870654 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.870753 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.870957 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.871044 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.871266 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.871353 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.871573 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.871721 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.871862 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.871995 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.872161 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.872300 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.872471 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.872613 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.872782 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.872916 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.873090 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.873247 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.873414 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.873560 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.873714 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.873847 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.874029 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.874117 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.874332 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.874422 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.874650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.874743 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.874955 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.875053 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.875257 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.875355 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.875584 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.875670 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.875888 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.875978 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.876212 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.876306 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.876518 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.876622 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.876818 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.876906 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.877121 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.877256 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.877463 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.877552 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.877770 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.877874 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.878082 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.878168 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.878388 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.878482 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.878695 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.878835 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.879000 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.879094 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.879309 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.879396 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.879614 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.879711 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.879918 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.880004 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.880224 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.880311 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.880532 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.880628 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.880836 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.880922 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.881146 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.881283 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.881477 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.881575 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.881786 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.881872 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.882091 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.882177 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.882392 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.882480 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.882699 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.882786 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.883007 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.883092 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.883322 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.883569 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.883657 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.883902 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.883988 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.884217 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.884311 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.884537 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.884772 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.884866 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.885108 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.885230 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.885453 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.885552 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.885775 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.885863 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.886119 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.886219 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.886436 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.886523 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.886747 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.886880 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.887051 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.887143 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.887354 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.887440 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.887660 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.887748 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.888240 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.888341 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.888544 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.888630 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.888844 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.888930 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.889150 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.889274 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.889480 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.889645 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.889780 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.889867 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.890080 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.890167 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.890383 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.890479 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.890684 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.890770 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.891005 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.891092 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.891306 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.891397 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.891609 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.891694 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.891918 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.892011 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.892222 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.892317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.892523 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.892615 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.892825 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.892910 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.893124 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.893248 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.893472 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.893567 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.893775 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.893871 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.894079 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.894167 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.894380 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.894467 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.894727 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.894814 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.895034 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.895122 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.895335 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.895428 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.895660 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.895758 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.895965 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.896050 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.896267 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.896355 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.896574 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.896673 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.896882 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.896975 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.897187 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.897338 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.897510 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.897610 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.897810 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.897896 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.898115 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.898201 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.898419 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.898517 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.898721 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.898808 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.899020 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.899105 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.899325 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.899420 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.899627 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.899714 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.899932 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.900018 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.900234 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.900320 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.900533 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.900628 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.900833 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.900928 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.901136 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.901243 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.901468 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.901566 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.901768 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.901853 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.902067 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.902154 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.902364 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.902450 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.902668 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.902762 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.902966 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.903052 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.903267 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.903362 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.903566 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.903661 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.903870 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.903955 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.904172 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.904265 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.904469 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.904563 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.904770 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.904863 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.905077 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.905172 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.905405 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.905506 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.905708 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.905803 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.906013 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.906102 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.906313 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.906408 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.907129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.907217 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.907437 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.907528 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.907746 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.907835 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.908051 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.908137 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.908351 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.908435 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.908658 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.908744 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.908959 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.909044 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.909289 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.909399 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.909593 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.909689 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.909900 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.909987 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.910199 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.910293 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.910500 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.910641 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.910800 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.910889 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.911103 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.911199 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.911402 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.911535 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.911705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.911821 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.912007 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.912132 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.912490 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.912608 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.912608 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.912804 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.912895 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.912984 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.913240 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.913347 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.913536 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.913622 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.913844 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.913931 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.914147 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.914247 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.914483 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.914571 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.914800 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.914888 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.915111 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.915199 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.915421 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.915507 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.915731 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.915820 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.916034 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.916121 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.916347 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.916433 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.916656 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.916743 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.916971 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.917055 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.917301 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.917431 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.917605 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.917703 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.917918 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.918014 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.918227 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.918404 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.918528 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.918630 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.918832 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.918918 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.919153 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.919249 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.919464 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.919549 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.919766 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.919858 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.920074 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.920170 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.920384 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.920471 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.920689 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.920778 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.920997 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.921094 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.921333 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.921433 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.921640 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.921734 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.921948 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.922034 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.922794 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.922890 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.923115 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.923202 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.923429 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.923530 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.923736 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.923828 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.924044 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.924131 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.924352 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.924440 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.924656 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.924745 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.924958 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.925043 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.925295 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.925389 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.925601 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.925687 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.925903 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.926001 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.926204 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.926289 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.926514 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.926608 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.926815 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.926909 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.927125 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.927241 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.927431 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.927552 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.927738 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.927862 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.928043 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.928168 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.928467 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.928555 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.928774 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.928868 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.929082 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.929168 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.929413 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.929511 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.929714 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.929802 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.930023 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.930116 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.930339 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.930433 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.930652 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.930740 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.930958 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.931045 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.931309 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.931394 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.931611 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.931699 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.931919 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.932006 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.932245 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.932341 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.932547 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.932636 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.932850 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.932936 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.933151 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.933272 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.933499 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.933586 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.933801 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.933886 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.934104 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.934199 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.934420 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.934527 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.934730 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.934824 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.935034 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.935132 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.935353 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.935500 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.935768 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.935868 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.936078 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.936178 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.936382 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.936476 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.936717 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.936902 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.937045 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.937142 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.937377 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.937500 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.937692 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.937791 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.939737 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.939826 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.939917 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940006 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940099 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940181 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940260 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940337 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940425 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940514 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940595 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940674 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940752 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.940918 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941009 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941097 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941177 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941345 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941432 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941432 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941589 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941675 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941756 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941823 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.941909 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.942074 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.942163 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.942444 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.942538 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.942750 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.942852 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.943055 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.943141 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.943364 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.943458 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.943667 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.943768 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.943972 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.944060 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.944297 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.944387 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.944601 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.944703 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.944905 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.944993 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.945248 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.945340 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.945535 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.945624 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.945838 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.945925 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.946140 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.946229 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.946547 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.946759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.946845 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.947062 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.947148 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.947368 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.947457 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.947701 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.947837 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.947996 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.948091 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.948300 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.948387 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.948620 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.948715 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.948924 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.949019 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.949251 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.949356 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.949557 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.949645 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.949859 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.949956 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.950180 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.950266 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.950487 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.950574 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.950791 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.950887 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.951096 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.951183 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.951430 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.951517 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.951732 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.951828 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.952052 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.952140 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.952371 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.952456 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.952687 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.952783 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.952996 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.953085 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.953333 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.953423 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.953698 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.953788 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.954002 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.954091 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.954305 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.954391 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.954613 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.954702 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.954917 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.955003 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.955220 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.955307 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.955522 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.955609 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.955825 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.955923 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.956127 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.956223 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.956428 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.956515 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.956730 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.956823 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.957038 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.957139 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.957366 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.957457 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.957669 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.957795 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.957972 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.958145 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.958274 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.958360 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.958578 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.958669 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.958880 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.958978 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.959192 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.959287 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.959499 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.959587 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.959805 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.959904 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.960108 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.960199 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.960429 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.960515 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.960742 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.960838 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.961052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.961139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.961393 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.961484 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.961710 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.961799 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.962026 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.962120 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.962340 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.962427 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.962651 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.962738 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.962958 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.963054 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.963273 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.963369 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.963592 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.963691 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.963906 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.963991 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.964214 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.964427 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.964518 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.964756 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.964843 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.965070 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.965166 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.965406 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.965675 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.965764 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.966006 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.966094 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.966314 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.966415 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.966625 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.966720 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.966934 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.967069 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.967245 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.967335 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.967552 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.967640 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.967862 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.967956 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.968175 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.968265 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.968487 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.968574 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.968797 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.968885 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.969648 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.969789 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.969964 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.970052 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.970277 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.970378 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.970590 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.970680 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.970918 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.971004 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.971236 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.971325 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.971537 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.971623 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.971851 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.971939 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.972165 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.972254 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.972477 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.972564 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.972789 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.972877 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.973099 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.973188 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.973436 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.973524 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.973748 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.973848 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.974060 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.974157 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.974367 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.974454 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.974678 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.974783 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.974990 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.975077 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.975302 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.975390 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.975615 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.975751 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.975930 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.976046 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.976242 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.976339 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.976554 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.976644 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.976868 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.976956 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.977207 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.977418 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.977540 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.977734 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.977859 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.978069 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.978168 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.978397 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.978688 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.978777 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.979011 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.979106 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.979325 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.979411 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.979653 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.979741 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.979960 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.980059 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.980266 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.980364 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.980576 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.980663 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.980883 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.980970 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.981187 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.981312 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.981532 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.981621 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.981844 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.981930 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.982147 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.982245 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.982452 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.982539 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.982759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.982855 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.983079 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.983287 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.983378 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.983632 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.983721 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.983950 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.984046 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.984274 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.984513 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.984614 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.985479 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.985582 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.985806 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.985896 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.986130 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.986216 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.986440 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.986529 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.986750 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.986838 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.987058 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.987144 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.987367 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.987466 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.987673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.987769 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.987977 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.988065 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.988288 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.988462 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.988594 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.988682 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.988897 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.988984 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.989214 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.989317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.989527 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.989613 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.989835 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.989960 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.990144 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.990242 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.990447 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.990532 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.990752 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.990838 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.991060 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.991147 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.991363 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.991452 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.991667 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.991831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.991972 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.992068 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.992271 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.992358 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.992580 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.992666 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.992881 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.992969 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.993186 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.993290 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.993513 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.993599 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.993823 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.993920 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.994127 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.994213 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.994438 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.994525 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.994746 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.994835 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.995060 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.995147 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.995362 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.995456 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.995666 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.995762 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.995981 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.996075 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.996290 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.996387 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.996607 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.996693 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.996916 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.997003 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.997252 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.997357 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.997565 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.997651 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.997889 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.997977 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.998205 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.998418 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.998514 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.998751 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.998838 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.999071 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.999167 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.999403 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.999678 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:47.999806 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.000013 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.000102 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.000338 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.000435 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.000648 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.000736 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.000972 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.001060 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.001312 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.001420 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.001627 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.001725 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.001937 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.002033 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.002247 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.002334 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.002555 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.002641 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.002863 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.002959 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.003170 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.003266 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.003477 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.003564 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.003784 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.003880 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.004092 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.004185 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.004396 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.004489 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.004704 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.004792 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.005007 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.005093 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.005338 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.005432 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.005651 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.005748 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.005963 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.006059 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.006272 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.006360 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.006582 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.006671 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.006897 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.006983 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.007219 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.007305 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.007528 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.007620 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.007836 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.007924 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.008146 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.008693 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.008826 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.008936 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.008936 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.009156 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.009286 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.009408 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.009519 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.009626 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.009740 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.009849 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.009999 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.010335 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.010450 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.010651 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.010766 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.010958 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.011081 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.011308 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.011622 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.011735 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.011947 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.012061 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.012268 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.012383 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.012583 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.012699 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.013141 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.013316 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.013486 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.013600 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.013814 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.013928 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.014127 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.014253 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.014452 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.014567 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.014763 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.014886 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.015069 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.015192 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.015375 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.015490 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.015682 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.015797 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.016503 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.016641 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.016824 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.016948 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.017132 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.017279 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.017503 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.017628 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.017775 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.017902 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.018098 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.018818 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.018940 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019052 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019158 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019263 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019376 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019493 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019586 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019674 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019755 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019841 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.019921 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.020009 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.020123 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.020219 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.020425 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.020520 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.020726 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.020814 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.021030 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.021118 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.021353 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.021482 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.021658 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.021754 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.021958 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.022044 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.022261 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.022347 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.022561 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.022649 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.022865 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.022955 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.023167 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.023256 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.023475 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.023563 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.023780 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.023875 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.024091 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.024189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.024397 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.024484 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.024765 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.024857 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.025044 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.025146 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.025378 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.025467 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.025698 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.025783 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.026009 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.026108 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.026328 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.026415 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.026637 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.026723 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.026961 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.027057 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.027268 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.027355 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.027591 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.027714 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.027902 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.028002 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.028214 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.028311 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.028527 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.028624 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.028838 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.028941 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.029169 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.029297 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.029486 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.029639 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.029785 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.029926 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.030094 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.030233 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.030428 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.030569 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.030745 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.030895 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.031039 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.031181 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.031358 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.031501 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.032208 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.032344 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.032532 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.032670 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.032860 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.032967 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.033177 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.033296 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.033513 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.033599 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.033826 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.033916 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.034144 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.034230 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.034450 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.034591 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.034762 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.034852 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.035074 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.035160 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.035386 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.035472 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.035699 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.035787 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.036013 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.036101 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.036321 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.036406 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.036639 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.036726 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.036960 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.037045 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.037307 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.037412 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.037625 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.037773 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.037953 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.038048 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.038281 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.038382 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.038597 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.038683 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.038911 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.039007 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.039216 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.039328 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.039464 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 14:48:48.039597 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.039886 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.040200 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.040507 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:48:48.040751 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 14:48:48.193897 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Registered counter for database nova_api Sep 09 14:48:48.198133 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO dbcounter [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Registered counter for database nova_api Sep 09 14:48:48.215536 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:48:48.217596 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_db.sqlalchemy.engines [None req-c7497298-0063-42c6-af8e-89e5749020be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:48:48.222337 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:48:48.224044 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writer thread running {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:48:48.280065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.context [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14f5c374-113e-49b8-9575-27f7b8860d4a(cell1) {{(pid=105420) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 14:48:48.281962 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.context [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14f5c374-113e-49b8-9575-27f7b8860d4a(cell1) {{(pid=105421) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 14:48:48.284062 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:48:48.284535 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:48:48.285800 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_concurrency.lockutils [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:48:48.286129 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:48:48.286279 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_concurrency.lockutils [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:48:48.286839 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:48:48.287280 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:48:48.287866 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_concurrency.lockutils [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:48:48.288588 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_concurrency.lockutils [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:48:48.289037 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_concurrency.lockutils [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:48:48.289262 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:48:48.291060 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_concurrency.lockutils [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105421) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:48:48.291224 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Registered counter for database nova_cell0 Sep 09 14:48:48.293023 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO dbcounter [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Registered counter for database nova_cell0 Sep 09 14:48:48.295311 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Registered counter for database nova_cell1 Sep 09 14:48:48.296963 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO dbcounter [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Registered counter for database nova_cell1 Sep 09 14:48:48.303657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:48:48.304973 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:48:48.306721 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_db.sqlalchemy.engines [None req-c7497298-0063-42c6-af8e-89e5749020be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:48:48.309789 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_db.sqlalchemy.engines [None req-c7497298-0063-42c6-af8e-89e5749020be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:48:48.310425 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:48:48.312285 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writer thread running {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:48:48.447784 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:48:48.451351 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writer thread running {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:48:48.458171 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO dbcounter [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Registered counter for database nova_cell0 Sep 09 14:48:48.460687 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO dbcounter [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Registered counter for database nova_cell0 Sep 09 14:48:48.464904 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_db.sqlalchemy.engines [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:48:48.469091 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG oslo_db.sqlalchemy.engines [None req-c7497298-0063-42c6-af8e-89e5749020be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:48:48.469637 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writer thread running {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:48:48.473705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writer thread running {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:48:48.807273 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 14:48:48.808383 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: WARNING keystonemiddleware.auth_token [None req-c7497298-0063-42c6-af8e-89e5749020be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 14:48:48.815161 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 14:48:48.816164 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: WARNING keystonemiddleware.auth_token [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 14:48:49.162930 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 14:48:49.168894 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: WARNING keystonemiddleware.auth_token [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 14:48:49.172505 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: WARNING keystonemiddleware.auth_token [None req-c7497298-0063-42c6-af8e-89e5749020be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 14:48:49.174250 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596b8e679c0 pid: 105420 (default app) Sep 09 14:48:49.176335 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:48:49.177559 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Sep 09 14:48:49.178202 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Fri Sep 9 14:48:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:48:49.178598 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: WARNING keystonemiddleware.auth_token [None req-c7497298-0063-42c6-af8e-89e5749020be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 14:48:49.183916 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596b8e679c0 pid: 105421 (default app) Sep 09 14:50:10.494339 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:10.496223 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002346 Sep 09 14:50:10.501530 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:10.515313 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writing DB stats nova_api:SELECT=3 {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:10.516480 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writing DB stats nova_cell0:SELECT=3 {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:10.517457 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writing DB stats nova_cell1:SELECT=3 {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:10.518517 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:11.370116 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-d0cc0644-9879-4af4-bc50-ab62979069a6 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:11.402308 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-d0cc0644-9879-4af4-bc50-ab62979069a6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.897896 Sep 09 14:50:11.403129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Sep 9 14:50:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:50:14.082204 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:14.083060 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-375bda2b-4ce2-47c4-9998-4cc45171da0b None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 09 14:50:14.083451 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:14.555596 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-f5c5e298-2afa-4581-9575-bc72bc3d70a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "name": "cirros256", "ram": 256, "id": "c1"}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:14.602872 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-f5c5e298-2afa-4581-9575-bc72bc3d70a5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.513201 Sep 09 14:50:14.603636 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:50:14.616774 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:14.617600 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell0:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:14.619491 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell1:SELECT=3 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:14.620515 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:14.836277 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-b68c8934-e31d-4aae-af1e-046f00cefd49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:14.905740 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-b68c8934-e31d-4aae-af1e-046f00cefd49 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293966 Sep 09 14:50:14.906330 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 14:50:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:50:17.552448 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-f5c5e298-2afa-4581-9575-bc72bc3d70a5 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:17.553437 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-f5c5e298-2afa-4581-9575-bc72bc3d70a5 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 09 14:50:17.553835 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:18.227479 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-a6f4b79f-dcd7-4496-9d7c-d8194d33a4ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:18.268571 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-a6f4b79f-dcd7-4496-9d7c-d8194d33a4ba admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.708025 Sep 09 14:50:18.268571 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:50:18.281143 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-9d17d045-74f4-45b5-a556-ce3d4a93ff7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:18.319609 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-9d17d045-74f4-45b5-a556-ce3d4a93ff7a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042645 Sep 09 14:50:18.320209 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 14:50:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:50:20.907246 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-a6f4b79f-dcd7-4496-9d7c-d8194d33a4ba admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:20.908274 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-a6f4b79f-dcd7-4496-9d7c-d8194d33a4ba admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 09 14:50:20.908676 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:21.324229 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-88b16f4e-dac1-40d0-934f-aa7276d67384 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "swap": 0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:21.344841 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-88b16f4e-dac1-40d0-934f-aa7276d67384 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427553 Sep 09 14:50:21.345452 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 14:50:21.357756 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-7cbdf16b-f602-4225-8d37-ba908fbfc606 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:21.386790 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-7cbdf16b-f602-4225-8d37-ba908fbfc606 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032744 Sep 09 14:50:21.387372 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 14:50:21 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:50:23.998891 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-88b16f4e-dac1-40d0-934f-aa7276d67384 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:24.000237 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-88b16f4e-dac1-40d0-934f-aa7276d67384 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001783 Sep 09 14:50:24.000644 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:24.418739 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e8d94e8a-5869-4695-967e-98518b0226bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:24.438811 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e8d94e8a-5869-4695-967e-98518b0226bb admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432153 Sep 09 14:50:24.439555 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:50:24.451918 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-cb5148c8-9098-432c-ac47-0b9696bf07e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:24.478051 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-cb5148c8-9098-432c-ac47-0b9696bf07e6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030341 Sep 09 14:50:24.478633 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 14:50:24 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:50:27.104281 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e8d94e8a-5869-4695-967e-98518b0226bb admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:27.105359 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e8d94e8a-5869-4695-967e-98518b0226bb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Sep 09 14:50:27.105796 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:27.534731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-ad8106e2-bfd9-4a8c-9e62-1a2375d61e9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:27.553311 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-ad8106e2-bfd9-4a8c-9e62-1a2375d61e9c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440546 Sep 09 14:50:27.553858 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 14:50:27.567548 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-d7f97248-d611-450c-9002-5f5e6bf91fef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:27.598198 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-d7f97248-d611-450c-9002-5f5e6bf91fef admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035567 Sep 09 14:50:27.598931 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 14:50:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:50:30.194404 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-ad8106e2-bfd9-4a8c-9e62-1a2375d61e9c admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:30.195565 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-ad8106e2-bfd9-4a8c-9e62-1a2375d61e9c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Sep 09 14:50:30.195971 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:30.650550 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-9f0acef5-11c5-4b20-899d-9740e8cfb418 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:30.675520 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-9f0acef5-11c5-4b20-899d-9740e8cfb418 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.473380 Sep 09 14:50:30.676063 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Sep 9 14:50:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:50:33.651588 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-ad8106e2-bfd9-4a8c-9e62-1a2375d61e9c admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:33.652623 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-ad8106e2-bfd9-4a8c-9e62-1a2375d61e9c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 09 14:50:33.653041 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:34.051203 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e5165e35-4bf4-459d-95b8-3992b9a05224 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:34.085233 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e5165e35-4bf4-459d-95b8-3992b9a05224 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.421637 Sep 09 14:50:34.086012 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:50:34.098426 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-ea688af4-040f-44b7-9847-6eefc7ee2a2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:34.127192 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-ea688af4-040f-44b7-9847-6eefc7ee2a2e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032379 Sep 09 14:50:34.128056 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 14:50:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:50:36.720644 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e5165e35-4bf4-459d-95b8-3992b9a05224 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:36.721709 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e5165e35-4bf4-459d-95b8-3992b9a05224 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 09 14:50:36.722108 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:37.076289 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-4c7dc63d-164f-4c25-a59f-ec2cfd15ada1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "name": "m1.small", "ram": 2048}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:37.097847 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-4c7dc63d-164f-4c25-a59f-ec2cfd15ada1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.369492 Sep 09 14:50:37.098503 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:50:37.111025 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-313ad56a-0f1a-4d78-8216-1f382799579f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:37.136156 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-313ad56a-0f1a-4d78-8216-1f382799579f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029308 Sep 09 14:50:37.136954 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 14:50:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:50:39.767306 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-4c7dc63d-164f-4c25-a59f-ec2cfd15ada1 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:39.768390 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-4c7dc63d-164f-4c25-a59f-ec2cfd15ada1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Sep 09 14:50:39.768808 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:40.219597 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-b298af45-1526-494b-a1e8-0c9edffb5d36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:40.242601 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-b298af45-1526-494b-a1e8-0c9edffb5d36 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.467764 Sep 09 14:50:40.243152 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:50:40.255604 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-b146ef5a-594e-41be-90bc-d5f515cbee88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:40.285171 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-b146ef5a-594e-41be-90bc-d5f515cbee88 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033062 Sep 09 14:50:40.285721 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 14:50:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:50:42.898386 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-b298af45-1526-494b-a1e8-0c9edffb5d36 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:42.899405 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-b298af45-1526-494b-a1e8-0c9edffb5d36 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 09 14:50:42.899840 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:43.392763 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-321f9150-aed8-4973-917e-5b97bb73a3c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "name": "m1.large"}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:43.401553 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:43.416733 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-321f9150-aed8-4973-917e-5b97bb73a3c6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.510226 Sep 09 14:50:43.417297 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 14:50:43.429408 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-7dd54c7d-334b-470a-9bd3-537b1facf48c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:43.456588 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-7dd54c7d-334b-470a-9bd3-537b1facf48c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030964 Sep 09 14:50:43.469228 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 14:50:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:50:46.183820 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-321f9150-aed8-4973-917e-5b97bb73a3c6 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:50:46.185403 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-321f9150-aed8-4973-917e-5b97bb73a3c6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Sep 09 14:50:46.185810 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:50:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:50:46.640526 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-f5bd8f12-7889-49fd-9d6d-95fb4fcf0b7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:46.650639 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:46.667366 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-f5bd8f12-7889-49fd-9d6d-95fb4fcf0b7e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.475169 Sep 09 14:50:46.673348 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 14:50:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 14:50:46.680688 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-076f8ac7-a656-40d4-a788-8ad5aa127eda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:50:46.707071 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-076f8ac7-a656-40d4-a788-8ad5aa127eda admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030823 Sep 09 14:50:46.717293 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 14:50:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:51:03.683249 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-f5bd8f12-7889-49fd-9d6d-95fb4fcf0b7e admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:03.684832 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-f5bd8f12-7889-49fd-9d6d-95fb4fcf0b7e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 09 14:51:03.685255 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:51:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:51:03.695775 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:04.070721 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-a059b700-abe2-4e48-a47e-f3ee35d24fb4 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:04.088377 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-a059b700-abe2-4e48-a47e-f3ee35d24fb4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397039 Sep 09 14:51:04.088913 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Sep 9 14:51:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:51:05.388396 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-f5bd8f12-7889-49fd-9d6d-95fb4fcf0b7e admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:05.389678 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-f5bd8f12-7889-49fd-9d6d-95fb4fcf0b7e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 09 14:51:05.390068 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:51:05.916014 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-4a2c09c4-54c0-4ad0-a7cb-a05ab6c8fc4e admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:05.921816 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.wsgi [None req-4a2c09c4-54c0-4ad0-a7cb-a05ab6c8fc4e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-4a2c09c4-54c0-4ad0-a7cb-a05ab6c8fc4e admin admin] Request method failure captured: Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Accept: application/json Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Accept-Encoding: gzip, deflate Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Connection: keep-alive Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Content-Length: 0 Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Host: 10.222.0.15 Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Openstack-Api-Version: compute 2.92 Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Openstack-System-Scope: None Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: User-Agent: python-novaclient Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Auth-Token: gAAAAABjG1LZPzX7HSI2U1gSQZbWRCyGbnN_a8E-kz1_rMhQzF-jkh21kJVkZj6iGxLmF5nh2DE2Hy6QtoHfYnPVjAxhAst-5VHu6dN-ohDsApcCisyljxBOno4qDsXuXVa9xjzaOMxeOCklQaLwkW0wS_t59NymIy3Y2eza0p79WBsofFcz5QE Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Domain-Id: None Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Domain-Name: None Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Identity-Status: Confirmed Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Is-Admin-Project: True Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Domain-Id: default Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Domain-Name: Default Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Name: admin Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Role: admin,reader,member Sep 09 14:51:05.924945 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Roles: admin,reader,member Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5aff011fa0544761b3d08887135e99aa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Tenant: admin Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Tenant-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Tenant-Name: admin Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User: admin Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Domain-Id: default Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Domain-Name: Default Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Id: 3ec2e03066934f2597854e78a5c4d345 Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Name: admin Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: method: > Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: exception: Flavor 42 could not be found. Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: action_args: {'id': '42'} Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:51:05.926602 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:05.928705 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:05.930129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-4a2c09c4-54c0-4ad0-a7cb-a05ab6c8fc4e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:51:05.931544 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-4a2c09c4-54c0-4ad0-a7cb-a05ab6c8fc4e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389045 Sep 09 14:51:05.931544 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Sep 9 14:51:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:05.936287 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-1d01fb85-33ac-4550-89dd-8ba830ffc157 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:05.958129 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-1d01fb85-33ac-4550-89dd-8ba830ffc157 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025508 Sep 09 14:51:05.958641 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 14:51:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:51:05.969369 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-33992b45-b14c-4f55-b9d8-b74738ebe6f3 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:05.991120 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-33992b45-b14c-4f55-b9d8-b74738ebe6f3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026637 Sep 09 14:51:05.991647 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 14:51:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:51:06.000914 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-4743e2dc-99e4-409c-98c4-106996f67530 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:06.006047 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.wsgi [None req-4743e2dc-99e4-409c-98c4-106996f67530 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-4743e2dc-99e4-409c-98c4-106996f67530 admin admin] Request method failure captured: Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Accept: application/json Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Accept-Encoding: gzip, deflate Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Connection: keep-alive Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Content-Length: 0 Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Host: 10.222.0.15 Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Openstack-Api-Version: compute 2.92 Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Openstack-System-Scope: None Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: User-Agent: python-novaclient Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Auth-Token: gAAAAABjG1LZPzX7HSI2U1gSQZbWRCyGbnN_a8E-kz1_rMhQzF-jkh21kJVkZj6iGxLmF5nh2DE2Hy6QtoHfYnPVjAxhAst-5VHu6dN-ohDsApcCisyljxBOno4qDsXuXVa9xjzaOMxeOCklQaLwkW0wS_t59NymIy3Y2eza0p79WBsofFcz5QE Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Domain-Id: None Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Domain-Name: None Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Identity-Status: Confirmed Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Is-Admin-Project: True Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Domain-Id: default Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Domain-Name: Default Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Name: admin Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Role: admin,reader,member Sep 09 14:51:06.009317 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Roles: admin,reader,member Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5aff011fa0544761b3d08887135e99aa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Tenant: admin Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Tenant-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Tenant-Name: admin Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User: admin Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Domain-Id: default Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Domain-Name: Default Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Id: 3ec2e03066934f2597854e78a5c4d345 Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Name: admin Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: method: > Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: exception: Flavor 42 could not be found. Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: action_args: {'id': '42'} Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:51:06.010581 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:06.011381 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:06.012724 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-4743e2dc-99e4-409c-98c4-106996f67530 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:51:06.015267 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-4743e2dc-99e4-409c-98c4-106996f67530 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013472 Sep 09 14:51:06.015267 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Sep 9 14:51:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:07.221943 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-33992b45-b14c-4f55-b9d8-b74738ebe6f3 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:07.222981 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-33992b45-b14c-4f55-b9d8-b74738ebe6f3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 09 14:51:07.223376 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:51:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:51:07.739159 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e0bc1b6f-07fa-4233-b1aa-d1edf64c89bf admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:07.744232 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.wsgi [None req-e0bc1b6f-07fa-4233-b1aa-d1edf64c89bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e0bc1b6f-07fa-4233-b1aa-d1edf64c89bf admin admin] Request method failure captured: Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Accept: application/json Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Accept-Encoding: gzip, deflate Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Connection: keep-alive Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Content-Length: 0 Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Host: 10.222.0.15 Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Openstack-Api-Version: compute 2.92 Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Openstack-System-Scope: None Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: User-Agent: python-novaclient Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Auth-Token: gAAAAABjG1LbWxmxKamLN033j1rFKYfhz69_1yYrbkdJFNb-Nr2hCIf_K3HSJdkRR35ZnOgtKlR2p9Us1yYLbT-c-Xb0aJDquAKWsLihoM0S7MAFa7rX2_2YhEG7LeXjGPF9iHeBqbrpNtmYTHKA87omLmrt8QvuS5hnlkcSMZFRfoEJWavcC2c Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Domain-Id: None Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Domain-Name: None Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Identity-Status: Confirmed Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Is-Admin-Project: True Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Domain-Id: default Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Domain-Name: Default Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Name: admin Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Role: admin,reader,member Sep 09 14:51:07.745759 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Roles: admin,reader,member Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5aff011fa0544761b3d08887135e99aa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Tenant: admin Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Tenant-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Tenant-Name: admin Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User: admin Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Domain-Id: default Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Domain-Name: Default Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Id: 3ec2e03066934f2597854e78a5c4d345 Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Name: admin Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: method: > Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: exception: Flavor 84 could not be found. Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: action_args: {'id': '84'} Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:51:07.748052 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:07.749065 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.750935 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-e0bc1b6f-07fa-4233-b1aa-d1edf64c89bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:51:07.752617 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-e0bc1b6f-07fa-4233-b1aa-d1edf64c89bf admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387515 Sep 09 14:51:07.752988 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Sep 9 14:51:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:07.760381 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-ce32c65b-bc2c-4cf9-b579-5d4926781774 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:07.775411 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-ce32c65b-bc2c-4cf9-b579-5d4926781774 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018624 Sep 09 14:51:07.775972 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 14:51:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:51:07.785181 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3bb984e5-566b-437a-b77a-dd757f0613a0 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:07.800819 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3bb984e5-566b-437a-b77a-dd757f0613a0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019075 Sep 09 14:51:07.801350 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 14:51:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:51:07.811026 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-bdad7e22-a727-48ca-a704-895879ab108d admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:07.816088 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.wsgi [None req-bdad7e22-a727-48ca-a704-895879ab108d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-bdad7e22-a727-48ca-a704-895879ab108d admin admin] Request method failure captured: Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Accept: application/json Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Accept-Encoding: gzip, deflate Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Connection: keep-alive Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Content-Length: 0 Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Host: 10.222.0.15 Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Openstack-Api-Version: compute 2.92 Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Openstack-System-Scope: None Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: User-Agent: python-novaclient Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Auth-Token: gAAAAABjG1LbWxmxKamLN033j1rFKYfhz69_1yYrbkdJFNb-Nr2hCIf_K3HSJdkRR35ZnOgtKlR2p9Us1yYLbT-c-Xb0aJDquAKWsLihoM0S7MAFa7rX2_2YhEG7LeXjGPF9iHeBqbrpNtmYTHKA87omLmrt8QvuS5hnlkcSMZFRfoEJWavcC2c Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Domain-Id: None Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Domain-Name: None Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Identity-Status: Confirmed Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Is-Admin-Project: True Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Domain-Id: default Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Domain-Name: Default Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Name: admin Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Role: admin,reader,member Sep 09 14:51:07.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Roles: admin,reader,member Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5aff011fa0544761b3d08887135e99aa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Tenant: admin Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Tenant-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Tenant-Name: admin Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User: admin Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Domain-Id: default Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Domain-Name: Default Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Id: 3ec2e03066934f2597854e78a5c4d345 Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Name: admin Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: method: > Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: exception: Flavor 84 could not be found. Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: action_args: {'id': '84'} Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:51:07.819650 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:07.820642 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:07.822139 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-bdad7e22-a727-48ca-a704-895879ab108d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:51:07.823371 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-bdad7e22-a727-48ca-a704-895879ab108d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012454 Sep 09 14:51:07.823371 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Sep 9 14:51:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 14:51:09.054163 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3bb984e5-566b-437a-b77a-dd757f0613a0 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:09.055166 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3bb984e5-566b-437a-b77a-dd757f0613a0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 09 14:51:09.055555 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:51:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:51:09.579982 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-d8174302-3d87-4a5c-b038-5cc759750915 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:09.585793 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.wsgi [None req-d8174302-3d87-4a5c-b038-5cc759750915 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-d8174302-3d87-4a5c-b038-5cc759750915 admin admin] Request method failure captured: Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Accept: application/json Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Accept-Encoding: gzip, deflate Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Connection: keep-alive Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Content-Length: 0 Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Host: 10.222.0.15 Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Openstack-Api-Version: compute 2.92 Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Openstack-System-Scope: None Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: User-Agent: python-novaclient Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Auth-Token: gAAAAABjG1LcFfqkLhf4__ZAVbrLIbxqnr0w5rvnxMiv73EGttCVDSkBrOUDvYaEM_3hNrNF4PDaBjAiuNi0v5NLFJOEudn_TKoteRbUL92y8JrKPegTXQ9xOpcB7U4i-Xnoas5lA-1EXP4TEAl3gWAW_-VwzoLOO2jVQ9Z01YwNqJYNGHGp0tQ Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Domain-Id: None Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Domain-Name: None Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Identity-Status: Confirmed Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Is-Admin-Project: True Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Domain-Id: default Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Domain-Name: Default Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Project-Name: admin Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Role: admin,reader,member Sep 09 14:51:09.587273 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Roles: admin,reader,member Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5aff011fa0544761b3d08887135e99aa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Tenant: admin Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Tenant-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-Tenant-Name: admin Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User: admin Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Domain-Id: default Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Domain-Name: Default Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Id: 3ec2e03066934f2597854e78a5c4d345 Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: X-User-Name: admin Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: method: > Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: exception: Flavor 451 could not be found. Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: action_args: {'id': '451'} Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:51:09.588831 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:09.589731 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.591324 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-d8174302-3d87-4a5c-b038-5cc759750915 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:51:09.592306 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-d8174302-3d87-4a5c-b038-5cc759750915 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393909 Sep 09 14:51:09.592306 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 14:51:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:09.598891 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-9a87bd27-541c-43ab-a433-ccbee5c7a9d7 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:09.614503 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-9a87bd27-541c-43ab-a433-ccbee5c7a9d7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019201 Sep 09 14:51:09.615014 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 14:51:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:51:09.624313 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:09.638752 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018075 Sep 09 14:51:09.639281 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 14:51:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:51:09.648402 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-0b4a326e-ea2b-4916-aa38-9fc87d01e74e admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:09.653716 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.wsgi [None req-0b4a326e-ea2b-4916-aa38-9fc87d01e74e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-0b4a326e-ea2b-4916-aa38-9fc87d01e74e admin admin] Request method failure captured: Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Accept: application/json Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Accept-Encoding: gzip, deflate Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Connection: keep-alive Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Content-Length: 0 Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Host: 10.222.0.15 Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Openstack-Api-Version: compute 2.92 Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Openstack-System-Scope: None Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: User-Agent: python-novaclient Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Auth-Token: gAAAAABjG1LcFfqkLhf4__ZAVbrLIbxqnr0w5rvnxMiv73EGttCVDSkBrOUDvYaEM_3hNrNF4PDaBjAiuNi0v5NLFJOEudn_TKoteRbUL92y8JrKPegTXQ9xOpcB7U4i-Xnoas5lA-1EXP4TEAl3gWAW_-VwzoLOO2jVQ9Z01YwNqJYNGHGp0tQ Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Domain-Id: None Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Domain-Name: None Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Identity-Status: Confirmed Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Is-Admin-Project: True Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Domain-Id: default Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Domain-Name: Default Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Project-Name: admin Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Role: admin,reader,member Sep 09 14:51:09.655189 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Roles: admin,reader,member Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5aff011fa0544761b3d08887135e99aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5aff011fa0544761b3d08887135e99aa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Tenant: admin Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Tenant-Id: 5aff011fa0544761b3d08887135e99aa Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-Tenant-Name: admin Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User: admin Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Domain-Id: default Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Domain-Name: Default Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Id: 3ec2e03066934f2597854e78a5c4d345 Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: X-User-Name: admin Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: method: > Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: exception: Flavor 451 could not be found. Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: action_args: {'id': '451'} Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:51:09.656673 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:09.657657 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: ERROR nova.api.openstack.wsgi Sep 09 14:51:09.659053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-0b4a326e-ea2b-4916-aa38-9fc87d01e74e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:51:09.660296 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-0b4a326e-ea2b-4916-aa38-9fc87d01e74e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011528 Sep 09 14:51:09.660296 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 14:51:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:10.879631 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:10.880641 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 09 14:51:10.881037 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:51:11.401933 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-bbca695a-6598-46cc-99a5-e947c516b0aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:51:11.421880 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-bbca695a-6598-46cc-99a5-e947c516b0aa admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401409 Sep 09 14:51:11.422451 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Sep 9 14:51:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:51:12.647346 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:12.648353 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 09 14:51:12.648753 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:51:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:51:13.172795 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-466293d8-29f6-4d28-a3d5-075ba4c2597b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:51:13.192054 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-466293d8-29f6-4d28-a3d5-075ba4c2597b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.406349 Sep 09 14:51:13.192624 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Sep 9 14:51:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:51:14.432621 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:14.433652 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 09 14:51:14.434051 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:51:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:51:14.965160 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-60a42d3b-22ed-46ae-b6b6-35d98aa7c7bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:51:14.983167 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-60a42d3b-22ed-46ae-b6b6-35d98aa7c7bb admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.413028 Sep 09 14:51:14.983699 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Sep 9 14:51:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 14:51:16.202004 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:16.202999 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 09 14:51:16.203395 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:51:16.732170 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-408497c9-c47f-40c8-bf28-93d2181fc875 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:51:16.751132 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-408497c9-c47f-40c8-bf28-93d2181fc875 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.412735 Sep 09 14:51:16.751683 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Sep 9 14:51:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:51:17.962412 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:17.963445 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 09 14:51:17.963839 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:51:18.482386 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-3d234aed-0bfb-4b64-b630-261dbc7b2de4 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:51:18.503407 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-3d234aed-0bfb-4b64-b630-261dbc7b2de4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403409 Sep 09 14:51:18.503933 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Fri Sep 9 14:51:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:52:15.244029 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:52:15.245049 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-368d6d40-1225-4dcb-b3d5-8ecd507918aa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 09 14:52:15.245601 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 14:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:52:15.256578 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:15.630838 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-1b8509f1-6263-4f07-b330-ffab9a2fa9c9 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:52:15.650971 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-1b8509f1-6263-4f07-b330-ffab9a2fa9c9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398850 Sep 09 14:52:15.651508 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Sep 9 14:52:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:52:15.673109 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writing DB stats nova_api:SELECT=14 {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:15.677133 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-54495efb-b910-4d28-bfc6-d706edc062af admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:52:15.684381 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-54495efb-b910-4d28-bfc6-d706edc062af admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012668 Sep 09 14:52:15.684906 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Fri Sep 9 14:52:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:52:15.696187 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-820d675b-e177-4d33-8466-da4911bd33d3 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:52:15.703330 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-820d675b-e177-4d33-8466-da4911bd33d3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010754 Sep 09 14:52:15.703830 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Fri Sep 9 14:52:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:52:15.714672 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:52:15.722089 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010856 Sep 09 14:52:15.722603 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Fri Sep 9 14:52:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:52:15.734041 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-b96aa7f6-2be6-46b1-be26-fb6e26c7f925 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:52:15.740797 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-b96aa7f6-2be6-46b1-be26-fb6e26c7f925 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010842 Sep 09 14:52:15.741321 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Fri Sep 9 14:52:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:55:10.813330 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:55:10.814997 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Sep 09 14:55:10.815701 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:55:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:55:10.956516 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=6 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:55:11.123053 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-488deb8c-d433-48e7-850d-1a4af6f20ccf admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:55:11.127755 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-488deb8c-d433-48e7-850d-1a4af6f20ccf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:55:11.128224 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-488deb8c-d433-48e7-850d-1a4af6f20ccf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:55:11.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-488deb8c-d433-48e7-850d-1a4af6f20ccf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:55:11.129395 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-488deb8c-d433-48e7-850d-1a4af6f20ccf admin admin] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:55:11.129843 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-488deb8c-d433-48e7-850d-1a4af6f20ccf admin admin] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:55:11.130253 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-488deb8c-d433-48e7-850d-1a4af6f20ccf admin admin] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:55:11.161224 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-488deb8c-d433-48e7-850d-1a4af6f20ccf admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.205830 Sep 09 14:55:11.161764 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 14:55:10 2022] GET /compute/v2.1/os-services => generated 794 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:55:12.253352 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:55:12.254362 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 09 14:55:12.254760 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:55:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:55:12.445039 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-689c28b3-9af4-423d-b0c5-2976277f5455 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:55:12.448429 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-689c28b3-9af4-423d-b0c5-2976277f5455 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:55:12.448901 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-689c28b3-9af4-423d-b0c5-2976277f5455 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:55:12.449361 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-689c28b3-9af4-423d-b0c5-2976277f5455 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:55:12.450068 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-689c28b3-9af4-423d-b0c5-2976277f5455 admin admin] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:55:12.451111 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-689c28b3-9af4-423d-b0c5-2976277f5455 admin admin] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:55:12.451534 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-689c28b3-9af4-423d-b0c5-2976277f5455 admin admin] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:55:12.470166 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-689c28b3-9af4-423d-b0c5-2976277f5455 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077736 Sep 09 14:55:12.470698 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 14:55:12 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:55:23.962152 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:55:23.963313 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Sep 09 14:55:23.963729 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:55:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:55:24.106533 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell0:SELECT=4 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:55:24.107253 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_cell1:SELECT=4 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:55:24.107866 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG dbcounter [-] [105420] Writing DB stats nova_api:SELECT=8 {{(pid=105420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:55:24.157339 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-60b41417-2954-4a53-a6b4-24162208471a admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:55:24.160916 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-60b41417-2954-4a53-a6b4-24162208471a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:55:24.161507 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-60b41417-2954-4a53-a6b4-24162208471a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:55:24.161939 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-60b41417-2954-4a53-a6b4-24162208471a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:55:24.162655 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-60b41417-2954-4a53-a6b4-24162208471a admin admin] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:55:24.163106 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-60b41417-2954-4a53-a6b4-24162208471a admin admin] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:55:24.163763 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-60b41417-2954-4a53-a6b4-24162208471a admin admin] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:55:24.196518 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-60b41417-2954-4a53-a6b4-24162208471a admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.094381 Sep 09 14:55:24.197014 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 14:55:24 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:55:25.270716 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG nova.api.openstack.wsgi [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] Calling method '>' {{(pid=105421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:55:25.271729 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: INFO nova.api.openstack.requestlog [None req-dcbc0f66-5e5e-4b82-bc40-f97fac42bb63 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 09 14:55:25.272129 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: [pid: 105421|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 14:55:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:55:25.460014 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG nova.api.openstack.wsgi [None req-943e3603-dfc1-4c8a-b07a-18df3baf8269 admin admin] Calling method '>' {{(pid=105420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:55:25.463431 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-943e3603-dfc1-4c8a-b07a-18df3baf8269 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:55:25.463938 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-943e3603-dfc1-4c8a-b07a-18df3baf8269 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:55:25.464369 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-943e3603-dfc1-4c8a-b07a-18df3baf8269 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:55:25.465086 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-943e3603-dfc1-4c8a-b07a-18df3baf8269 admin admin] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:55:25.465572 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-943e3603-dfc1-4c8a-b07a-18df3baf8269 admin admin] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:55:25.466480 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: DEBUG oslo_concurrency.lockutils [None req-943e3603-dfc1-4c8a-b07a-18df3baf8269 admin admin] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105420) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:55:25.488160 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: INFO nova.api.openstack.requestlog [None req-943e3603-dfc1-4c8a-b07a-18df3baf8269 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.078381 Sep 09 14:55:25.488642 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: [pid: 105420|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 14:55:25 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:56:22.183931 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: Fri Sep 9 14:56:22 2022 - graceful shutdown triggered... Sep 09 14:56:22.184440 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: Gracefully killing worker 2 (pid: 105421)... Sep 09 14:56:22.185536 dv-cinder-828696-11-iscsi devstack@n-api.service[105420]: Gracefully killing worker 1 (pid: 105420)... Sep 09 14:56:22.187236 dv-cinder-828696-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 14:56:22.310931 dv-cinder-828696-11-iscsi devstack@n-api.service[105421]: DEBUG dbcounter [-] [105421] Writing DB stats nova_api:SELECT=4 {{(pid=105421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:56:23.185153 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: worker 1 buried after 1 seconds Sep 09 14:56:23.185153 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: worker 2 buried after 1 seconds Sep 09 14:56:23.185153 dv-cinder-828696-11-iscsi devstack@n-api.service[105419]: goodbye to uWSGI. Sep 09 14:56:23.186660 dv-cinder-828696-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 14:56:23.187202 dv-cinder-828696-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 14:56:23.189895 dv-cinder-828696-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 14:56:23.206630 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 14:56:23 2022] *** Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: nodename: dv-cinder-828696-11-iscsi Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: machine: x86_64 Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: clock source: unix Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: pcre jit disabled Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: detected number of CPU cores: 4 Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: current working directory: / Sep 09 14:56:23.208627 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: detected binary path: /usr/bin/uwsgi-core Sep 09 14:56:23.209748 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: your processes number limit is 47680 Sep 09 14:56:23.209748 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: your memory page size is 4096 bytes Sep 09 14:56:23.209748 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: detected max file descriptor number: 2048 Sep 09 14:56:23.209748 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: lock engine: pthread robust mutexes Sep 09 14:56:23.209748 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: thunder lock: enabled Sep 09 14:56:23.209748 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 14:56:23.209748 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 14:56:23.248332 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: Python main interpreter initialized at 0x555bdb6e99c0 Sep 09 14:56:23.248332 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: python threads support enabled Sep 09 14:56:23.248332 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: your server socket listen backlog is limited to 100 connections Sep 09 14:56:23.248332 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: your mercy for graceful operations on workers is 90 seconds Sep 09 14:56:23.248770 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 14:56:23.248770 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: *** Operational MODE: preforking *** Sep 09 14:56:23.249038 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: *** uWSGI is running in multiple interpreter mode *** Sep 09 14:56:23.249038 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: spawned uWSGI master process (pid: 120630) Sep 09 14:56:23.249260 dv-cinder-828696-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 14:56:23.249832 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: spawned uWSGI worker 1 (pid: 120642, cores: 1) Sep 09 14:56:23.250845 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: spawned uWSGI worker 2 (pid: 120643, cores: 1) Sep 09 14:56:23.250845 dv-cinder-828696-11-iscsi devstack@n-api.service[120630]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 14:56:23.916228 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 14:56:23.916849 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 14:56:25.076932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:56:25.076932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: from cryptography.utils import int_from_bytes Sep 09 14:56:25.077658 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:56:25.077658 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: from cryptography.utils import int_from_bytes Sep 09 14:56:25.077963 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:56:25.077963 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: from cryptography.utils import int_from_bytes Sep 09 14:56:25.078377 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:56:25.078377 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: from cryptography.utils import int_from_bytes Sep 09 14:56:27.524646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 14:56:27.525359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 14:56:27.525479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 14:56:27.525786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 14:56:27.526042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 14:56:27.526430 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.526753 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.527074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.527320 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 14:56:27.527690 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.527792 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 14:56:27.527875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.528063 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.528655 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 14:56:27.528853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.529034 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 14:56:27.529147 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.529264 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 14:56:27.529492 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.529659 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.529762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.529973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.530147 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.530306 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.530497 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828696-11-iscsi {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.530659 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.530805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.530964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.531120 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.531267 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.531411 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.531567 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.531722 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.531882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.532028 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.532180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.532338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.532483 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.532642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.532788 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.533079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828696-11-iscsi {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.533267 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.541359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.541359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.541579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.541669 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.541761 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.541854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.541938 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542031 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542123 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542216 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542307 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542398 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542490 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542490 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542663 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542764 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542849 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.542939 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.543030 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.543127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.543235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.543235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.543403 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828696-11-iscsi {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.543500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.543595 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.543686 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.544393 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.544504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.544601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.544702 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.544793 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.544881 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.544965 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545276 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828696-11-iscsi {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545372 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545471 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545566 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545662 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545756 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.545943 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546035 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546396 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546487 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546571 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546653 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.546920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547003 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547085 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547272 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547460 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547552 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547552 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547721 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547906 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.547997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548169 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548259 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548455 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548545 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548637 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548729 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.548918 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.549011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.549091 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.549186 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.557729 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.557845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.557940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558038 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558213 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558213 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558551 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558829 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.558923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559016 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559101 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559400 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559602 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559695 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559779 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.559958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560126 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560209 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560291 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560474 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560566 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560834 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.560937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561036 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561121 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561222 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561321 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561414 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561693 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.561977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.562074 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.562160 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.562253 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.562338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.562428 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.562766 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.562874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.562955 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563034 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563185 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563276 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563470 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563644 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563737 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.563992 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564083 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564167 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564250 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564509 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564686 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564864 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.564959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.565051 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.565138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.573305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.573436 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.573538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.573617 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.573691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.573772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.573846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.573929 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574013 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574094 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574175 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574256 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574330 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574415 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574575 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574647 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574729 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574887 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.574960 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575036 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575215 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575306 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575377 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575465 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575540 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575621 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575694 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575765 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.575936 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576112 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576285 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576369 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576451 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576534 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576685 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576755 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576840 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.576920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577000 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577083 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577342 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577427 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577507 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577598 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577671 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577751 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.577933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578094 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578253 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578413 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578486 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578486 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578634 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578634 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578788 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.578940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.579011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.579089 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.579174 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.579248 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.580229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.580335 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.580417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.580504 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.580586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.580658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.580737 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.580816 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.580896 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.580977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.581058 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.581131 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.581422 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.581596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.581749 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.581906 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.582061 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.582209 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.582363 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:56:27.582511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.582669 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.582824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.582978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.583145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.583294 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.583449 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.583605 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.583754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.583910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.584067 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.584224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.584923 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.585167 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.585358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.585516 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.585664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.585833 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.585982 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.586140 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.586298 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.586594 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.586749 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.586907 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.587056 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.587203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.587359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.587518 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.587666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.587833 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.588556 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.588731 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.588882 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.589032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.589188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.589417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.589583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.589742 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.589899 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.590048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.590195 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.590342 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.590509 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.591155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.591308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.591455 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.591602 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.591756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.591903 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.592065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.592226 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.592374 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.592529 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.592676 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.592831 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.592994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.593143 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.593327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.593493 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.593655 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.593829 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.593992 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.594148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.594309 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.594494 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.595244 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.595420 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.595577 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.595751 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.595915 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.596070 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.596224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.596388 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.596571 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.596843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.597050 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.597260 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.597435 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.597601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.597772 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.597941 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.598116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.598275 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.598444 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.598607 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.598768 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.598960 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.599119 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.599272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.599440 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.599642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.599796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.599992 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.599992 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.600327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.600499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.600662 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.600817 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.600969 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.601122 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.601300 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.601300 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.601656 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.601816 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.601969 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.602130 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.602310 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.602466 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.602629 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.602791 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.602946 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.603107 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.603271 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.603434 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.603589 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.603750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.603912 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.604065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.604233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.604406 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.604569 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.604569 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.605504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.605504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.605822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.605976 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.606145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.606145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.607081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.607081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.607386 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.607534 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.607700 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.607858 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.608015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.608172 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.608328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.608476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.608684 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.608834 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.608982 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.609150 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.609381 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.609578 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.609755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.609911 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.610066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.610235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.610390 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.610543 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.610696 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.610861 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.611031 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.611198 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.611353 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.611514 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.611678 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.611852 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.612017 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.612183 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.612339 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.612502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.612657 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.612819 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.612983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.613146 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.613325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.613491 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.613646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.613808 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.613982 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.614139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.614292 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.614292 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.614591 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.614754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.615526 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.615705 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.615870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.616025 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.616180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.616412 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.616581 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.616743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.616906 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.617152 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.617336 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.617506 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.617669 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.617831 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.617994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.618157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.618327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.618497 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.618652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.618652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.618973 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.619136 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.619308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.619472 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.619668 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.619839 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.619994 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.620147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.620314 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.620476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.620631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.620792 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.620957 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.621121 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.621310 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.621469 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.621630 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.621791 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.621987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.622151 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.622323 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.622487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.622649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.622803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.622957 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.623140 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.623303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.623458 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.623613 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.623613 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.623922 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.623922 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.624230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.624391 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.624545 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.624707 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.624869 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.625531 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.626020 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.626222 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.626393 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.626549 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.626704 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.626867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.627022 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.627195 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.627423 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.627582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.627736 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.627900 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.628076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.628230 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.628383 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.628536 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.628704 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.628869 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.629031 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.629185 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.629364 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.629364 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.629673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.629884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.630044 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.630217 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.630372 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.630525 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.630688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.630842 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.631003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.631158 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.631312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.631466 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.631629 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.631791 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.631947 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.632100 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.632264 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.632433 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.632596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.632750 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.632911 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.632911 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.633245 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.633419 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.633574 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.633574 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.633890 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.633890 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.634183 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.634358 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.634513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.634685 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.634980 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.635611 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.635979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.635979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.636300 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.636452 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.636613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.636768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.636920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.637089 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.637276 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.637453 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.637792 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.637949 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.638118 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.638273 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.638434 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.638588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.638740 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.638893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.639055 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.639209 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.639382 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.639545 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.639708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.639910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.640082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.640237 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.640390 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.640551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.640713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.640874 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.641045 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.641262 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.641437 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.641611 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.641774 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.641938 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.642093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.642245 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.642408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.642562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.642724 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.642899 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.643054 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.643240 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.643419 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.643588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.643755 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.643921 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.644085 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.644246 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.644401 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.644556 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.644709 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.644875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.645037 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.645225 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.645830 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.646194 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.646365 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.646365 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.646683 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.646838 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.647000 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.647000 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.647316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.647473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.647633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.647879 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.648040 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.648202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.648370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.648534 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.648702 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.649115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.649293 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.649449 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.649715 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.649897 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.650109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.650276 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.650438 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.650602 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.650765 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.650947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.651269 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.651440 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.651596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.651763 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.651928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.652089 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.652251 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.652414 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.652568 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.652568 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.652884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.653040 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.653732 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.653904 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.654073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.654236 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.654391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.654552 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.654552 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.654855 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.655021 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.655184 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.655347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.655937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.655937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.656454 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.656628 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.656784 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.656937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.657102 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.657339 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.657511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.657667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.657667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.658069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.658243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.658432 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.658673 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.658852 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.659017 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.659182 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.659337 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.659499 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.659663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.659825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.660008 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.660209 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.660380 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.660535 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.660689 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.660856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.661032 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.661187 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.661368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.661532 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.661687 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.661855 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.662010 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.662164 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.662328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.662481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.662634 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.662796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.662958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.663123 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.663277 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.663431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.663592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.663756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.663918 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.664073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.664226 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.664388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.664554 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.664717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.664889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.665052 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.665255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.665417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.665417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.666171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.666344 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.666608 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.667362 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.667529 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.667697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.667852 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.667852 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.668258 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.668258 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.668582 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.668582 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.669463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.669631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.669794 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.669958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.670122 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.670334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.670502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.670658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.670821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.670982 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.671163 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.671319 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.671472 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.671634 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.671789 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.671952 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.672119 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.672275 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.672437 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.672600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.672762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.672933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.673095 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.673328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.673500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.673656 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.673819 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.673989 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.674145 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.674308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.674463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.674626 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.674780 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.674952 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.675108 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.675270 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.675437 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.675597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.675597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.676359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.676537 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.676791 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.676961 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.677124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.677316 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.677578 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.677745 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.677908 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.678094 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.678439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.678612 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.678768 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.678931 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.679086 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.679240 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.679454 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.679629 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.679785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.679947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.680109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.680265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.680473 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.680647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.680803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.680957 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.681110 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.681287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.681461 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.681631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.681794 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.681949 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.682103 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.682257 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.682426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.682600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.682754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.682908 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.683068 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.683224 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.683224 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.683536 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.683698 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.683853 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.684006 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.684168 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.684438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.684601 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.684777 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.684932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.685095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.685280 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.685451 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.685620 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.685786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.685941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.686477 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.686656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.687073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.687243 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.687399 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.687594 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.687836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.687945 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.688035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.688165 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.688262 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.688380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.688606 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.688715 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.688805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.688942 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.689059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.689173 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.689391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.689517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.689641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.689756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.689878 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.690001 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.690127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.690250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.690365 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.690535 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.690661 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.690783 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.690909 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.691025 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.691147 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.691263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.691385 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.691500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.691684 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.691803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.691917 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.692038 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.692161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.692283 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.692407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.692522 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.692647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.692763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.692884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.693013 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.693129 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.693321 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.693452 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.693567 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.693687 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.693817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.693939 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.694053 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.694167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.694280 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.694393 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.694515 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.694630 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.694743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.694856 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.694976 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.695091 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.695218 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.695333 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.695446 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.695559 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.695684 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.695815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.695931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.696052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.696166 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.696627 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.696751 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.696876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.697007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.697284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.697406 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.697537 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.697652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.697776 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.697993 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.698124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.698239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.698361 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.698483 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.698631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.698826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.698945 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.699075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.699190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.699319 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.699443 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.699558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.699672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.699785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.699899 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.700049 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.700181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.700304 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.700427 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.700586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.700725 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.700850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.700973 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.701095 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.701289 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.701433 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.701566 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.701743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.701743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.701983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.701983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.702215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.702340 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.702463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.702578 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.702691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.702811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.702926 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.703049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.703163 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.703284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.703407 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.703561 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.703687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.703812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.703933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.704048 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.704161 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.704275 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.704387 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.704515 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.704639 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.704755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.704867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.704981 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.705108 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.705243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.705376 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.705492 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.705621 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.705742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.705870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.705870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.706091 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.706213 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.706328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.706795 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.706933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.707050 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.707186 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.707391 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.707519 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.707641 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.707771 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.707887 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.708018 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.708018 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.708344 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.708474 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.708589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.708589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.708819 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.708819 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.709145 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.709305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.709421 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.709547 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.709663 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.709855 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.709980 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.710095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.710217 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.710341 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.710455 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.710579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.710740 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.710861 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.710976 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.710976 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.711195 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.711195 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.711195 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.711195 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.711195 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.711745 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.711866 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.711990 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.712112 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.712227 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.712347 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.712461 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.712584 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.712706 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.712828 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.712941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.713062 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.713184 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.713350 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.713484 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.713606 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.713721 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.713835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.713835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.714053 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.714168 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.714288 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.714403 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.714515 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.714627 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.714754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.714868 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.714980 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.715101 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.715215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.715342 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.715464 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.715585 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.716239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.716364 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.716477 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.716942 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.717067 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.717191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.717333 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.717559 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.717680 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.717810 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.717927 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.718052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.718176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.718402 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.718524 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.718650 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.718787 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.718903 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.719036 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.719225 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.719368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.719493 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.719616 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.719731 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.719854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.719977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.720100 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.720225 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.720349 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.720470 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.720585 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.720699 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.720876 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.720992 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.721114 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.722277 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.722428 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.722552 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.722681 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.722804 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.722930 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.723052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.723174 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.723302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.723427 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.723555 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.723678 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.723806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.723932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.724065 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.724188 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.724310 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.724431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.724557 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.724679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.724807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.724922 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.725043 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.725168 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.725326 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.725464 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.725594 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.725716 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.727222 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.727429 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.727842 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.727842 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.729891 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.730109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.730361 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.730662 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.730939 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.730939 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.732023 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.732303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.732597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.732884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.733191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.733547 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.733836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.734130 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.734307 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.734450 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.734695 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.734870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.735125 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.735301 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.735467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.735624 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.735807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.735968 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.736124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.736272 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.736427 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.736575 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.736737 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.737318 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.737499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.737660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.737929 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.738092 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.738259 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.738627 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.738796 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.738967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.738967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.739270 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.739436 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.739614 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.739933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.740099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.740260 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.740425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.740583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.740743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.740958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.741123 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.741293 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.741468 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.741468 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.741750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.741904 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.742065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.742213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.742373 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.742532 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.742688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.742688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.743000 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.743156 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.743320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.743476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.744334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.744334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.744637 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.744797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.744958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.745118 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.745381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.745545 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.745704 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.745859 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.746016 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.746182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.746343 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.746500 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.746663 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.746819 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.747041 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.747672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.747855 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.748142 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.748307 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.748457 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.748634 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.748879 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.749082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.749269 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.749441 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.749600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.749768 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.750174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.750418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.750604 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.750886 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.751099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.751269 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.751428 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.751578 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.751734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.751894 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.752053 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.752210 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.752371 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.752543 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.752703 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.752864 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.753032 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.753246 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.753418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.753578 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.753742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.753898 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.754057 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.754212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.754362 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.754522 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.754680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.754839 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.754988 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.755144 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.755301 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.755449 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.755449 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.755743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.755891 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.756045 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.756211 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.756373 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.756373 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.756704 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.756870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.756870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.757846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.757846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.757846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.757846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.757846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.757846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.757846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.757846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.759618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.759618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.759618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.759618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.759618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.759618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.759618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.759618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.761187 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.761187 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.761187 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.761187 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.761851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.762021 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.762189 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.762348 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.762995 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.763169 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.763324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.763478 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.763642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.763806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.763962 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.764131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.764303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.764467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.764467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.764783 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.764939 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.765108 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.765287 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.765455 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.765609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.765764 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.765916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.766080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.766244 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.766244 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.766565 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.766728 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.766899 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.767055 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.767222 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.767376 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.767538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.767986 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.768166 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.768353 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.768601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.768770 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.768934 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.769101 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.769296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.769482 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.769651 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.769814 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.769976 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.770147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.770147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.770555 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.770720 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.770886 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.771049 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.771334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.771508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.771664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.771826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.771991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772156 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772321 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772477 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.772632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.774099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.774099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.774099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.774556 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.774718 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.774872 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.774872 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.775190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.775190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.775499 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.775656 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.775832 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.775997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.776162 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.776324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.776487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.776487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.776487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.776487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.776487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.776487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.777445 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.777608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.777608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.778826 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.779159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.779334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.779530 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.779691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.779855 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.780025 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.780191 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.780375 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.780608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.780782 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.780782 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.781102 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.781397 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.781572 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.781729 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.781892 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.782056 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.782225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.782380 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.782549 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.782549 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.782853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.783009 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.783178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.783178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.783528 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.783694 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.783858 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.784024 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.784187 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.784344 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.784507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.784663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.784827 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.784997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.785162 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.785404 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.785563 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.785754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.785922 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.786090 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.786245 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.786408 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.786570 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.786724 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.786896 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.787059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.787215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.787369 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.787549 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.787714 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.787884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.788340 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.788520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.788685 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.788848 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.789012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.789308 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.789491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.789660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.789824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.790005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.790176 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.790340 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.790503 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.790771 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.790936 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.791101 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.791271 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.791538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.791699 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.791853 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.792014 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.792169 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.792350 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.792506 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.792659 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.792812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.792977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.793142 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.793372 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.793531 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.793693 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.793693 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.793987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.793987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.794315 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.794478 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.794633 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.794785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.794948 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.795111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.795273 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.795429 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.795593 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.795748 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.795917 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.796071 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.796244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.796408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.796564 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.796717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.796882 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.797037 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.797238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.797399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.797554 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.797709 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.797883 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.798047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.798234 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.798661 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.798828 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.799005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.799169 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.799438 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.799610 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.799767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.799937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.800107 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.800263 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.800417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.800572 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.800767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.800997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.801170 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.801382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.801655 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.801862 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.802029 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.802192 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.802360 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.802516 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.802669 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.802833 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.802995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.803176 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.803332 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.803495 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.803649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.803802 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.803956 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.804124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.804288 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.804443 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.804596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.804764 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.804919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.805083 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.805279 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.805450 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.805613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.805778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.805940 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.806110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.806273 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.806435 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.806597 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.806752 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.806919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.807084 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.807263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.807420 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.807586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.807753 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.807918 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.808082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.808237 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.808417 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.808860 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.809029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.809029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.809363 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.809635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.809816 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.809972 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.810134 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.810304 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.810459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.810620 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.810784 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.810939 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.811260 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.811422 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.811686 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.811850 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.812005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.812172 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.812343 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.812505 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.812661 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.812822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.812987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.813141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.813340 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.813506 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.813661 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.813816 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.813970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.814144 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.814144 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.814459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.814614 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.814776 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.814932 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.815097 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.815260 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.815431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.815587 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.815749 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.815913 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.816077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.816247 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.816416 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.816581 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.816736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.816890 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.817053 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.817252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.817427 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.817592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.817758 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.817928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.818091 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.818265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.818429 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.818612 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.819035 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.819208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.819363 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.819538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.819794 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.819955 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.820124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.820287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.820441 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.820615 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.820781 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.820944 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.821113 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.821382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.821382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.821799 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.821799 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.822112 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.822281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.822445 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.822600 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.822755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.822755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.823060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.823060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.823378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.823540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.823696 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.823860 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.824029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.824185 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.824339 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.824339 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.824637 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.824810 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 14:56:27.824982 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:56:27.824982 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 14:56:27.859283 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO dbcounter [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Registered counter for database nova_api Sep 09 14:56:27.859613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Registered counter for database nova_api Sep 09 14:56:27.879302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_db.sqlalchemy.engines [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:56:27.880747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:56:27.885882 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writer thread running {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:56:27.887337 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:56:27.943051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.context [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14f5c374-113e-49b8-9575-27f7b8860d4a(cell1) {{(pid=120642) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 14:56:27.944072 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.context [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14f5c374-113e-49b8-9575-27f7b8860d4a(cell1) {{(pid=120643) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 14:56:27.947109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:56:27.947592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:56:27.948087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:56:27.948564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:56:27.949164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:56:27.949927 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:56:27.950727 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:56:27.950910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:56:27.951478 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:56:27.951927 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:56:27.952877 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:56:27.953935 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:56:27.954867 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO dbcounter [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Registered counter for database nova_cell0 Sep 09 14:56:27.955893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Registered counter for database nova_cell0 Sep 09 14:56:27.958834 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO dbcounter [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Registered counter for database nova_cell1 Sep 09 14:56:27.960249 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Registered counter for database nova_cell1 Sep 09 14:56:27.966811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_db.sqlalchemy.engines [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:56:27.969551 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:56:27.970229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:56:27.971741 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_db.sqlalchemy.engines [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:56:27.975306 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writer thread running {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:56:27.976996 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:56:27.982456 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:56:28.120963 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writer thread running {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:56:28.127354 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Registered counter for database nova_cell0 Sep 09 14:56:28.130866 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO dbcounter [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Registered counter for database nova_cell0 Sep 09 14:56:28.134090 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:56:28.137377 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_db.sqlalchemy.engines [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:56:28.139342 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:56:28.142418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writer thread running {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:56:28.465192 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 14:56:28.467824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: WARNING keystonemiddleware.auth_token [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 14:56:28.472629 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 14:56:28.475174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: WARNING keystonemiddleware.auth_token [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 14:56:28.818543 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 14:56:28.824607 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-66653937-ec93-409b-af88-0c6c2fd89a3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 14:56:28.826925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: WARNING keystonemiddleware.auth_token [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 14:56:28.830519 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555bdb6e99c0 pid: 120643 (default app) Sep 09 14:56:28.832930 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: WARNING keystonemiddleware.auth_token [None req-ea8dab92-3db6-4391-ae15-ff6a73e592fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 14:56:28.838371 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555bdb6e99c0 pid: 120642 (default app) Sep 09 14:57:07.659252 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:07.660955 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:07.662157 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:07.663253 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:08.162772 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acb5a6fd-9ba9-4479-a930-fa7e9361b460 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad367e1f0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:08.878835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acb5a6fd-9ba9-4479-a930-fa7e9361b460 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1c50754d-6efa-46bc-95f5-772c01222771" status: 200 len: 351 microversion: 2.1 time: 1.229046 Sep 09 14:57:08.885434 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1/1] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 14:57:07 2022] GET /compute/v2.1/os-volumes/1c50754d-6efa-46bc-95f5-772c01222771 => generated 351 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:11.030411 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:11.031957 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:11.034023 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:11.037889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:11.536792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ffea8729-9d47-4486-9d32-0a25d32e815c tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad36e8940>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:12.028426 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ffea8729-9d47-4486-9d32-0a25d32e815c tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/8233dc10-e507-4361-b91d-8c8f2bc22490" status: 200 len: 351 microversion: 2.1 time: 1.005007 Sep 09 14:57:12.029371 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 14:57:11 2022] GET /compute/v2.1/os-volumes/8233dc10-e507-4361-b91d-8c8f2bc22490 => generated 351 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:13.830439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9036e19-c126-4551-95a4-b3053a456a2b tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad3545280>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:14.041932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9036e19-c126-4551-95a4-b3053a456a2b tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/cefc63b8-4b34-4e0f-909b-500b48e7023d" status: 200 len: 350 microversion: 2.1 time: 0.230312 Sep 09 14:57:14.043187 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 14:57:13 2022] GET /compute/v2.1/os-volumes/cefc63b8-4b34-4e0f-909b-500b48e7023d => generated 350 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:14.057286 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d204b561-716d-4c3e-98b6-41afe9455ebc tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad34f41f0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:14.218124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d204b561-716d-4c3e-98b6-41afe9455ebc tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.165693 Sep 09 14:57:14.219136 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1134 bytes} [Fri Sep 9 14:57:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:14.233995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69ee48c8-cef3-4042-8dc2-d78af4004cb8 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad3545940>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:14.522984 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69ee48c8-cef3-4042-8dc2-d78af4004cb8 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.292698 Sep 09 14:57:14.523555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1149 bytes} [Fri Sep 9 14:57:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 14:57:14.539265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d7d5eb9b-68d4-4229-bf60-0a7c5b2db601 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad3510160>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:14.757593 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d7d5eb9b-68d4-4229-bf60-0a7c5b2db601 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.222906 Sep 09 14:57:14.758109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1134 bytes} [Fri Sep 9 14:57:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:14.772237 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40164824-1b11-4e40-afb9-286be7a16244 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad3545700>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:14.986737 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40164824-1b11-4e40-afb9-286be7a16244 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.218361 Sep 09 14:57:14.987314 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1167 bytes} [Fri Sep 9 14:57:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:15.003296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dc537732-febd-4983-80a6-61579dcbecee tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad35134c0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:15.214154 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dc537732-febd-4983-80a6-61579dcbecee tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.216655 Sep 09 14:57:15.215537 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1170 bytes} [Fri Sep 9 14:57:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:15.231826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec290e94-b884-4709-9e21-513304117544 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad35174c0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:15.416001 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec290e94-b884-4709-9e21-513304117544 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.190168 Sep 09 14:57:15.429174 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1155 bytes} [Fri Sep 9 14:57:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:15.430663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1e7ff9be-dba3-493f-bef6-bb5e283f8ef8 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad35138b0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:15.595175 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1e7ff9be-dba3-493f-bef6-bb5e283f8ef8 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.168712 Sep 09 14:57:15.605228 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 5/10] 10.222.0.15 () {58 vars in 1188 bytes} [Fri Sep 9 14:57:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 14:57:15.610044 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4fd82677-2365-44ac-878f-d4968c03bdf8 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] Calling method '.version_select at 0x7f8ad35458b0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:15.867052 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4fd82677-2365-44ac-878f-d4968c03bdf8 tempest-VolumesTestJSON-698086344 tempest-VolumesTestJSON-698086344-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.260941 Sep 09 14:57:15.868036 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1155 bytes} [Fri Sep 9 14:57:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:17.875824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-97666024", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "networks": [{"uuid": "9b0fd95b-9a64-4241-8e08-e70dc9acd68a"}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:18.112547 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] validate_networks() for [('9b0fd95b-9a64-4241-8e08-e70dc9acd68a', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:57:19.591785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:57:19.592380 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:57:19.592687 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:57:19.593294 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:57:19.593884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:57:19.628683 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:19.641473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:19.641918 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:19.646403 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:19.656698 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:19.658713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:19.787029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Getting quotas for project 3c2219444c1b4ad0a395880494ddbbe3. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:57:19.798608 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Getting quotas for user 1e123765a8724a89863d74221001dcd1 and project 3c2219444c1b4ad0a395880494ddbbe3. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:57:19.816325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:57:19.819308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:57:19.970480 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed337b52-2374-4f71-93ef-d239acb91d84 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.449939 Sep 09 14:57:19.973236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 6/12] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:57:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 14:57:19.988245 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50a61b18-85b1-49e4-9c5e-514ecc8a0776 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:19.990793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50a61b18-85b1-49e4-9c5e-514ecc8a0776 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:20.183959 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50a61b18-85b1-49e4-9c5e-514ecc8a0776 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:20.205955 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50a61b18-85b1-49e4-9c5e-514ecc8a0776 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1213 microversion: 2.1 time: 0.224646 Sep 09 14:57:20.207380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:19 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1213 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:21.233591 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c5d5c3c2-df60-4904-879d-4346cf242a2a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:21.234702 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c5d5c3c2-df60-4904-879d-4346cf242a2a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:21.426163 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c5d5c3c2-df60-4904-879d-4346cf242a2a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:21.464879 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c5d5c3c2-df60-4904-879d-4346cf242a2a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1213 microversion: 2.1 time: 0.239097 Sep 09 14:57:21.465622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 7/14] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:21 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:22.479335 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1797549229", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:22.491506 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:22.492792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:22.508459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:22.509158 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:22.509773 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:22.515192 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:22.515694 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:22.516142 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:22.734259 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] validate_networks() for [('6a104187-cf4f-4fc2-83b7-d6fe24d794dc', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:57:23.129038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:23.159055 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-38a24f26-981d-446d-864d-d6e3dce135ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1209 microversion: 2.1 time: 0.672225 Sep 09 14:57:23.163874 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:22 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1209 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:57:24.449578 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42e60d35-98fe-4101-8055-dd2cfb272264 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: .version_select at 0x7f8ad2ad98b0>, body: {"keypair": {"name": "tempest-keypair-222111713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtW4V6YiwYKB6as+6EV0Gkz/sUhRcfrqNI+TerJmuh9hkDSv4ntKk2tk47T43AbpGv0UuhsZS2+dhDmIoWfM5RMfsl+QVpP0uvEjmjYw0l6zqQCP9swLa1bxg14umg82g=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:24.533397 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-42e60d35-98fe-4101-8055-dd2cfb272264 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for project 063bdf7448ee45939287687b0e65dd97. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:57:24.552016 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-42e60d35-98fe-4101-8055-dd2cfb272264 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for user 770105b06e084179a819a54d28b70cdf and project 063bdf7448ee45939287687b0e65dd97. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:57:24.672098 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42e60d35-98fe-4101-8055-dd2cfb272264 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.177682 Sep 09 14:57:24.673418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 9/16] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 14:57:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:25.595519 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-be0ad873-77cd-493b-a6d9-d92c3fd0d93b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'create', calling method: .version_select at 0x7f8ad2b151f0>, body: {"keypair": {"name": "tempest-keypair-1124470571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMj3GyzT8B3WA5yYQQrZaue9Q+s1YdP4YFfWp4sCP5PSYsU6wI9vlZwJqe9vPdDDn6v4jou/IZBTBe8qo19QjZjjTK4cMhZadvYJ8Nt3xAN3N+N5opdU1YUVQCkLC/Ivw=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:25.671625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-be0ad873-77cd-493b-a6d9-d92c3fd0d93b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Getting quotas for project c83910e3ac2f4c8f9f127ab767bffd1a. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:57:25.687799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-be0ad873-77cd-493b-a6d9-d92c3fd0d93b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Getting quotas for user 3c0c848f7858486c91773b34047d8aad and project c83910e3ac2f4c8f9f127ab767bffd1a. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:57:25.811306 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-be0ad873-77cd-493b-a6d9-d92c3fd0d93b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.136467 Sep 09 14:57:25.816637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 10/17] 10.222.0.15 () {62 vars in 1200 bytes} [Fri Sep 9 14:57:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 14:57:25.838390 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:25.843231 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:25.873557 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:25.874438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:25.883450 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:25.884684 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:25.885420 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:25.886071 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:27.024882 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:27.033281 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0839f9f8-861b-4374-a185-47613c4fe59c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 1.207077 Sep 09 14:57:27.046481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 11/18] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:25 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:27.364921 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:57:27.369592 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:57:27.370243 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:57:27.371499 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:57:27.372073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:57:27.435059 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:27.439046 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:27.439684 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:27.440638 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:27.454619 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:27.455298 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:27.509587 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Getting quotas for project b8051535f56a4e17a0fa1eeab7c08ce7. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:57:27.520827 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Getting quotas for user cd6c40dd492e40599324ef05011895f3 and project b8051535f56a4e17a0fa1eeab7c08ce7. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:57:27.555909 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:57:27.563869 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:57:27.817861 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ee82d1a-88d7-4f17-95d9-a848edc36c30 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.660105 Sep 09 14:57:27.818918 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 8/19] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:57:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 5666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 14:57:27.831547 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-207439e5-fbc4-4522-8424-211b5bfa80d0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:27.832041 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-207439e5-fbc4-4522-8424-211b5bfa80d0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:28.080069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:28.080786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:28.100123 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-207439e5-fbc4-4522-8424-211b5bfa80d0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:28.109297 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-207439e5-fbc4-4522-8424-211b5bfa80d0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1222 microversion: 2.1 time: 0.281839 Sep 09 14:57:28.121349 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 12/20] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:27 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1222 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:28.141919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:28.154155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:28.155916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:28.162050 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:28.163209 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:28.165414 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:28.982892 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1750079514", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:29.141077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] validate_networks() for [('6a104187-cf4f-4fc2-83b7-d6fe24d794dc', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:57:29.607220 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:29.639424 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fbacf2c7-ede7-42b2-87ea-ef1efa79151d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 1.572988 Sep 09 14:57:29.643371 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 9/21] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:28 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:29.692026 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:30.600611 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:57:30.601314 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:57:30.601649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:57:30.602165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:57:30.602626 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:57:30.643466 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:30.643919 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:30.644375 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:30.645178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:30.645762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:30.646209 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:30.690782 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:30.692609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:30.717189 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Getting quotas for project b8051535f56a4e17a0fa1eeab7c08ce7. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:57:30.721529 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:30.726121 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:30.730372 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:30.732486 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Getting quotas for user cd6c40dd492e40599324ef05011895f3 and project b8051535f56a4e17a0fa1eeab7c08ce7. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:57:30.739923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:30.740430 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:30.747760 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:30.788052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:57:30.795887 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:57:30.959425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-820fd22b-033b-4375-acc6-1b6f546c4f8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.982438 Sep 09 14:57:30.961227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 13/22] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:57:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 14:57:30.984414 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cfb2ee21-04eb-4e30-b991-5ad0346b5497 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:30.989966 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cfb2ee21-04eb-4e30-b991-5ad0346b5497 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:31.583639 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cfb2ee21-04eb-4e30-b991-5ad0346b5497 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:31.615171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cfb2ee21-04eb-4e30-b991-5ad0346b5497 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1222 microversion: 2.1 time: 0.640594 Sep 09 14:57:31.629276 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 14/23] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:30 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1222 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:32.452579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:32.474565 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af541a7a-b9ac-49a5-af6d-72cd1990022f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 1.785884 Sep 09 14:57:32.476066 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 10/24] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:30 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:57:32.639371 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-afc201b1-a40e-4eb1-85d1-cc63d9e56477 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:32.639933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-afc201b1-a40e-4eb1-85d1-cc63d9e56477 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:32.887902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-afc201b1-a40e-4eb1-85d1-cc63d9e56477 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:32.899882 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-afc201b1-a40e-4eb1-85d1-cc63d9e56477 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1222 microversion: 2.1 time: 0.264663 Sep 09 14:57:32.906060 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 15/25] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:32 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1222 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:33.503163 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:33.503780 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:33.515938 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:33.516449 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:33.525738 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:33.528936 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:33.529453 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:33.529908 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:33.939153 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:33.939959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:33.953288 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:33.959283 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:33.959886 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:33.967097 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:33.967922 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:33.969689 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:34.091445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:34.100972 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1467cd7-2adb-4505-aaee-b45edf34b47b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 0.601935 Sep 09 14:57:34.103927 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 11/26] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:33 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:34.177321 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:34.193133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bdab4e3d-306c-4ee0-aa4b-210a5e94bc71 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1274 microversion: 2.1 time: 0.257675 Sep 09 14:57:34.214040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 16/27] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:33 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1274 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:57:35.129081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:35.129903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:35.141091 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:35.141868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:35.142462 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:35.143322 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:35.143929 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:35.144505 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:35.221361 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:35.224337 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:35.238807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:35.239548 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:35.240967 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:35.248661 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:35.249408 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:35.249999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:35.716775 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:35.738613 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e97e4d9-0815-49b2-8a0e-79c4976b913c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1280 microversion: 2.1 time: 0.521994 Sep 09 14:57:35.741595 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 17/28] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:35 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1280 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:36.359747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:36.370337 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9a0bb43-87c3-4d43-9a68-d1cc1627e04f tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 1.244955 Sep 09 14:57:36.374822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 12/29] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:35 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:36.766341 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:36.766962 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:36.783986 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:36.785718 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:36.788974 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:36.795493 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:36.796262 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:36.798062 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:37.003720 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:37.021915 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-31f1fbdb-c8f4-486a-8e86-a82bc3a863e7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1280 microversion: 2.1 time: 0.257996 Sep 09 14:57:37.044065 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 18/30] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:36 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:37.197774 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-715914868", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d5556e-7098-41ee-955a-f1126257e985"}], "security_groups": [{"name": "tempest-securitygroup--917800872"}], "key_name": "tempest-keypair-1124470571", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:37.224167 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-95fc586b-fd6f-4735-b8ba-aa893165ff76 req-2e20f982-0109-4b40-a4f4-5fe6742950c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1053d238-10c6-4e04-bb1c-10d883bab2a5", "tag": "acde1cfb-fe15-408e-9b75-038fe1bb658e"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:37.260977 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-95fc586b-fd6f-4735-b8ba-aa893165ff76 req-2e20f982-0109-4b40-a4f4-5fe6742950c1 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:37.262060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-95fc586b-fd6f-4735-b8ba-aa893165ff76 req-2e20f982-0109-4b40-a4f4-5fe6742950c1 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:37.262505 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-95fc586b-fd6f-4735-b8ba-aa893165ff76 req-2e20f982-0109-4b40-a4f4-5fe6742950c1 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:37.311732 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-95fc586b-fd6f-4735-b8ba-aa893165ff76 req-2e20f982-0109-4b40-a4f4-5fe6742950c1 service nova] Creating event network-changed:acde1cfb-fe15-408e-9b75-038fe1bb658e for instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 on hv-cinder-82869 Sep 09 14:57:37.312324 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-95fc586b-fd6f-4735-b8ba-aa893165ff76 req-2e20f982-0109-4b40-a4f4-5fe6742950c1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 14:57:37.312659 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-95fc586b-fd6f-4735-b8ba-aa893165ff76 req-2e20f982-0109-4b40-a4f4-5fe6742950c1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 14:57:37.317120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24fa8c64-727d-46a1-8c44-876062e8eb76 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:37.318356 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24fa8c64-727d-46a1-8c44-876062e8eb76 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:37.319460 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24fa8c64-727d-46a1-8c44-876062e8eb76 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:37.329805 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24fa8c64-727d-46a1-8c44-876062e8eb76 None None] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:37.330306 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24fa8c64-727d-46a1-8c44-876062e8eb76 None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:37.330949 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24fa8c64-727d-46a1-8c44-876062e8eb76 None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:37.351661 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.compute.rpcapi [None req-24fa8c64-727d-46a1-8c44-876062e8eb76 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 14:57:37.366503 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24fa8c64-727d-46a1-8c44-876062e8eb76 None None] Releasing lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 14:57:37.399631 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24fa8c64-727d-46a1-8c44-876062e8eb76 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.521466 Sep 09 14:57:37.402042 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 13/31] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 14:57:37.411624 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:37.417084 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:37.430315 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:37.431060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:37.431721 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:37.435106 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:37.436441 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:37.437316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:37.551651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=8 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:37.676866 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] validate_networks() for [('93d5556e-7098-41ee-955a-f1126257e985', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:57:38.676117 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:38.695184 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eecf9e57-239d-410f-a0e6-547690108c23 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 1.289978 Sep 09 14:57:38.697326 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 14/32] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:37 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:38.708527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:38.711476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:38.731736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:38.734147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:38.737037 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:38.741538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:38.742452 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:38.745385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:39.023582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:39.039601 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57addf9b-d856-48ae-899f-1883895b33d1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1280 microversion: 2.1 time: 0.340331 Sep 09 14:57:39.043055 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 15/33] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:38 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1280 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:39.486148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:57:39.487180 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:57:39.487927 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:57:39.488588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:57:39.489423 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:57:39.509961 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:39.516531 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:39.521555 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:39.525847 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:39.526387 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:39.529179 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:39.604971 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Getting quotas for project c83910e3ac2f4c8f9f127ab767bffd1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:57:39.614248 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Getting quotas for user 3c0c848f7858486c91773b34047d8aad and project c83910e3ac2f4c8f9f127ab767bffd1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:57:39.643448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:57:39.645590 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:57:39.705350 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:39.725687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:39.727078 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:39.732744 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3449a628-3d45-467a-8e92-c1842b6dfca1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.567320 Sep 09 14:57:39.734305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 19/34] 10.222.0.15 () {62 vars in 1188 bytes} [Fri Sep 9 14:57:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2570 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 09 14:57:39.754137 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-de636c53-4180-4380-a5b5-50557a232940 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:39.760441 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-de636c53-4180-4380-a5b5-50557a232940 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:39.777435 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:39.780686 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:39.781763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:39.788785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:39.789787 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:39.793138 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:39.989235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-de636c53-4180-4380-a5b5-50557a232940 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:40.006411 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-de636c53-4180-4380-a5b5-50557a232940 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:40.024999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-de636c53-4180-4380-a5b5-50557a232940 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:40.030416 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-de636c53-4180-4380-a5b5-50557a232940 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1281 microversion: 2.20 time: 0.283188 Sep 09 14:57:40.035577 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 20/35] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:39 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1281 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:40.072922 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:40.075568 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:40.099396 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:40.101433 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:40.103977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:40.111348 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:40.113935 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:40.115351 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:40.716290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:40.735846 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9064be3b-e3d5-4ff0-85b6-37c0b0995736 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1280 microversion: 2.1 time: 0.669012 Sep 09 14:57:40.737437 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 21/36] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:40 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1280 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:57:40.809901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-607350674", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ced1175-a542-4682-b032-b597d6969844"}], "security_groups": [{"name": "tempest-securitygroup--1150984979"}], "key_name": "tempest-keypair-222111713", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:41.088347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:41.100161 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51ad45fc-96e2-40bc-aa75-5b65a4498f5d tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 1.379251 Sep 09 14:57:41.105993 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 16/37] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:39 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:41.117887 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:41.118876 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:41.137743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:41.139916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:41.141823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:41.146739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:41.147711 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:41.148361 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:41.395195 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:41.410627 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:41.414914 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:41.417763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bce31fa3-1a8c-44c1-aae5-68f28bf5f618 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1285 microversion: 2.20 time: 0.306618 Sep 09 14:57:41.417763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 17/38] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:41 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1285 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:41.490840 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] validate_networks() for [('2ced1175-a542-4682-b032-b597d6969844', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:57:41.768408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:41.774179 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:41.811018 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:41.812596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:41.813898 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:41.815232 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:41.817097 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:41.818747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:42.641687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:42.651118 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06609c93-9ff2-4040-8c52-36b4c12bcce8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1322 microversion: 2.1 time: 0.894233 Sep 09 14:57:42.653440 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 18/39] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:41 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1322 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:57:42.660702 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:42.663461 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:42.684653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:42.694713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:42.696332 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:42.699841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:42.700771 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:42.703097 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:43.147973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:43.159201 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5817e84-e2c7-4536-a61d-8bb477c45ac6 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 0.504350 Sep 09 14:57:43.175493 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 19/40] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:42 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:43.181471 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:43.182076 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:43.202315 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:43.206139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:43.208302 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:43.210864 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:43.211579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:43.213744 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:43.314933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:57:43.315949 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:57:43.316742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:57:43.317358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:57:43.318754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:57:43.335294 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=37 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:43.343248 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:43.344193 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:43.345807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:43.351475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:43.353320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:43.354512 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:43.360932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:43.371919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:43.375282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:43.377168 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be7455a0-2d4b-42c4-abb5-6ba9a45d502f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1333 microversion: 2.20 time: 0.199604 Sep 09 14:57:43.382789 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:43 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1333 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:43.402526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=43 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:43.419091 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for project 063bdf7448ee45939287687b0e65dd97. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:57:43.426963 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for user 770105b06e084179a819a54d28b70cdf and project 063bdf7448ee45939287687b0e65dd97. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:57:43.444076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:57:43.446491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:57:43.557331 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f449201b-4228-4cbd-80da-82a9cfde8caa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.752502 Sep 09 14:57:43.562769 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:57:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 14:57:43.571949 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd781e9d-c986-497c-9672-92f3ceda3168 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:43.572696 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd781e9d-c986-497c-9672-92f3ceda3168 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:43.680948 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:43.682429 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:43.703372 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:43.703864 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:43.712347 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:43.713826 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:43.715513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:43.717574 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:43.970413 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd781e9d-c986-497c-9672-92f3ceda3168 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:43.984211 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd781e9d-c986-497c-9672-92f3ceda3168 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1240 microversion: 2.1 time: 0.415676 Sep 09 14:57:43.985127 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 21/43] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:43 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1240 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:44.002263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-203e63d5-8713-439d-95e6-1865eca47254 req-ccae9065-1b15-477c-866d-c9a65029a0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbddff0a-cdd3-4537-821e-decd3714e96d", "tag": "acf93c11-9610-4394-9769-af290e65bfdd"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:44.053743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-203e63d5-8713-439d-95e6-1865eca47254 req-ccae9065-1b15-477c-866d-c9a65029a0e7 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:44.054328 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-203e63d5-8713-439d-95e6-1865eca47254 req-ccae9065-1b15-477c-866d-c9a65029a0e7 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:44.054806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-203e63d5-8713-439d-95e6-1865eca47254 req-ccae9065-1b15-477c-866d-c9a65029a0e7 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:44.067093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-203e63d5-8713-439d-95e6-1865eca47254 req-ccae9065-1b15-477c-866d-c9a65029a0e7 service nova] Creating event network-changed:acf93c11-9610-4394-9769-af290e65bfdd for instance fbddff0a-cdd3-4537-821e-decd3714e96d on hv-cinder-82869 Sep 09 14:57:44.072624 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-203e63d5-8713-439d-95e6-1865eca47254 req-ccae9065-1b15-477c-866d-c9a65029a0e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082336 Sep 09 14:57:44.074577 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 22/44] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:44.184018 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:44.184773 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:44.193974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:44.194830 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:44.195516 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:44.198147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:44.200777 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:44.203556 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:44.722299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:44.731426 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d0c71dd-255f-4157-a989-e0b9481de856 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1322 microversion: 2.1 time: 1.056224 Sep 09 14:57:44.732353 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 23/45] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:43 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1322 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:44.737065 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:44.737723 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:44.743740 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:44.744296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:44.744877 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:44.746107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:44.746718 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:44.747291 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:44.829574 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:44.850006 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f5afbf8-a6b8-468b-8dc2-b8349944cf6a tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 0.670890 Sep 09 14:57:44.856843 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 23/46] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:44 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:44.923722 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:44.934593 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:44.936567 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:44.938659 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6e59e571-c485-4597-933b-3ea8c6f58e80 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1339 microversion: 2.20 time: 0.205291 Sep 09 14:57:44.939744 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 24/47] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:44 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1339 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:45.030694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:45.036437 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:45.044544 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:45.045846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:45.046500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:45.047511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:45.048951 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:45.049621 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:45.152882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:45.164144 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e56e853d-bc03-470c-87b6-8c5f7b4b0a70 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1292 microversion: 2.1 time: 0.140082 Sep 09 14:57:45.165136 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:45 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1292 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:45.755362 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:45.756004 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:45.764483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:45.764956 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:45.769943 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:45.773941 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:45.774566 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:45.776593 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:45.879693 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:45.880648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:45.891845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:45.892978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:45.893905 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:45.896840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:45.897583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:45.898327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:46.068610 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:46.078285 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b8dca04d-29f4-4abe-9472-9f8351880dc9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1322 microversion: 2.1 time: 0.328417 Sep 09 14:57:46.081876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 25/49] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:45 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:46.103327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:46.104188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:46.121392 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:46.121882 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:46.122312 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:46.123003 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:46.129575 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:46.130156 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:46.303327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:46.316188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:46.331261 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:46.335454 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-17f1b3f0-c4dc-4d94-8ded-cb69417f34de tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1339 microversion: 2.20 time: 0.248707 Sep 09 14:57:46.340363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:46 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1339 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:46.368190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:46.369501 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:46.402221 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:46.403173 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:46.404601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:46.409305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:46.410142 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:46.410968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:46.677704 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:46.721221 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:46.726322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-20c38843-a967-4908-a0f4-155b366c6f95 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1298 microversion: 2.1 time: 0.384635 Sep 09 14:57:46.729151 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 27/51] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:46 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1298 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:46.748266 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f747ca5e-dfc6-44b8-8401-6c702d75f3bb tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 0.872942 Sep 09 14:57:46.748744 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 25/52] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:45 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:57:47.108367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:47.108974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:47.119464 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:47.120198 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:47.122747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:47.123631 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:47.124781 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:47.126679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:47.169569 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-601baf45-7df8-43d4-b95f-06b025d4e46f req-b12c9ac9-b4c4-4838-a946-1952dd4f849b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211a0b66-c743-4309-943c-b2d6afbee2c6", "tag": "c8fdd88c-0583-47e2-a5ed-5152bcef3474"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:47.201387 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-601baf45-7df8-43d4-b95f-06b025d4e46f req-b12c9ac9-b4c4-4838-a946-1952dd4f849b service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:47.202080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-601baf45-7df8-43d4-b95f-06b025d4e46f req-b12c9ac9-b4c4-4838-a946-1952dd4f849b service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:47.202680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-601baf45-7df8-43d4-b95f-06b025d4e46f req-b12c9ac9-b4c4-4838-a946-1952dd4f849b service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:47.225411 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-601baf45-7df8-43d4-b95f-06b025d4e46f req-b12c9ac9-b4c4-4838-a946-1952dd4f849b service nova] Creating event network-changed:c8fdd88c-0583-47e2-a5ed-5152bcef3474 for instance 211a0b66-c743-4309-943c-b2d6afbee2c6 on hv-cinder-82869 Sep 09 14:57:47.225937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-601baf45-7df8-43d4-b95f-06b025d4e46f req-b12c9ac9-b4c4-4838-a946-1952dd4f849b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 14:57:47.226324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-601baf45-7df8-43d4-b95f-06b025d4e46f req-b12c9ac9-b4c4-4838-a946-1952dd4f849b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 14:57:47.227350 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e7a6854-726f-41af-9208-86b19e569415 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:47.227984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e7a6854-726f-41af-9208-86b19e569415 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:47.228416 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e7a6854-726f-41af-9208-86b19e569415 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:47.229124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e7a6854-726f-41af-9208-86b19e569415 None None] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:47.229600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e7a6854-726f-41af-9208-86b19e569415 None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:47.231121 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e7a6854-726f-41af-9208-86b19e569415 None None] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:47.241139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.compute.rpcapi [None req-8e7a6854-726f-41af-9208-86b19e569415 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 14:57:47.242260 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e7a6854-726f-41af-9208-86b19e569415 None None] Releasing lock "compute-rpcapi-router" {{(pid=120642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 14:57:47.259378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8e7a6854-726f-41af-9208-86b19e569415 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327936 Sep 09 14:57:47.260052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 28/53] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:47.348287 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:47.373470 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:47.374368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:47.387861 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:47.389415 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:47.392406 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:47.395178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:47.396233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:47.397229 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:47.852184 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:47.864498 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bfe7779e-b167-41e2-b6b3-afb5e3255f0d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1322 microversion: 2.1 time: 0.760295 Sep 09 14:57:47.887530 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 26/54] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:47 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1322 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:57:47.905394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:47.906147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:47.918370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:47.918953 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:47.919404 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:47.920121 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:47.922902 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:47.923349 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:47.927931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:48.059213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:48.070111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:48.071720 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:48.073141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-60b05288-a5f5-4ab7-ba66-f8a78745d90a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.706138 Sep 09 14:57:48.091847 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 29/55] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:47 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:48.092838 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:48.093491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:48.097212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:48.100656 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:48.101144 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:48.101604 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:48.102710 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:48.103314 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:48.103886 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:48.110117 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d9da49f-2929-4b15-97b3-6107b1e90c03 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1298 microversion: 2.1 time: 0.221030 Sep 09 14:57:48.113993 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 27/56] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:47 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1298 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:48.697754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:48.710124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-458e8dc4-cc7c-4352-abae-feb59eb35484 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 0.618727 Sep 09 14:57:48.713429 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 30/57] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:48 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:48.890782 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:48.891492 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:48.905343 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:48.907243 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:48.907410 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:48.910124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:48.912359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:48.913530 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:49.100535 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:49.101697 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:49.117496 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:49.125580 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:49.127165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:49.128315 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:49.128520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:49.139323 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:49.677350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:49.681555 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:49.688581 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82dfc748-6847-4815-9711-7cf8107f7582 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1322 microversion: 2.1 time: 0.803565 Sep 09 14:57:49.689743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 28/58] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:48 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1322 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:49.694159 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:49.697823 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:49.702508 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b850cd16-b7df-4d15-ad56-11dd82beaf41 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.606894 Sep 09 14:57:49.718155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 31/59] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:49 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:49.718759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:49.718759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:49.718759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:49.718759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:49.723915 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:49.724866 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:49.729041 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:49.729610 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:49.741227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:49.742217 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:49.752584 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:49.754114 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:49.754864 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:49.758230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:49.758826 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:49.759359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:50.284812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:50.306729 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0c79b17-44a2-4c46-8b29-f49bf1d220cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1366 microversion: 2.1 time: 0.615683 Sep 09 14:57:50.310843 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 29/60] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:49 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:50.365742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:50.379995 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6ba133aa-2b8b-484b-8ded-d82b2d9d2bfe tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 0.642640 Sep 09 14:57:50.380576 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 32/61] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:49 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:57:50.387238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-dff005fb-9a7d-4aad-9eb8-2d33c3110b6a req-e5c67e4c-48f3-46c3-a55b-2b9f514bced0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c93a5b-944b-43a7-95f6-e49c229603b6", "tag": "17769411-6be9-4b42-9e21-4af2ee1d89cc"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:50.409796 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-dff005fb-9a7d-4aad-9eb8-2d33c3110b6a req-e5c67e4c-48f3-46c3-a55b-2b9f514bced0 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:50.411427 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-dff005fb-9a7d-4aad-9eb8-2d33c3110b6a req-e5c67e4c-48f3-46c3-a55b-2b9f514bced0 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:50.411877 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-dff005fb-9a7d-4aad-9eb8-2d33c3110b6a req-e5c67e4c-48f3-46c3-a55b-2b9f514bced0 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:50.430191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-dff005fb-9a7d-4aad-9eb8-2d33c3110b6a req-e5c67e4c-48f3-46c3-a55b-2b9f514bced0 service nova] Creating event network-changed:17769411-6be9-4b42-9e21-4af2ee1d89cc for instance 70c93a5b-944b-43a7-95f6-e49c229603b6 on hv-cinder-82869 Sep 09 14:57:50.436443 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-dff005fb-9a7d-4aad-9eb8-2d33c3110b6a req-e5c67e4c-48f3-46c3-a55b-2b9f514bced0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054625 Sep 09 14:57:50.437818 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 33/62] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:50.498522 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-728b0736-fffa-4733-b163-0fdabf7d6519 req-325d8f51-5750-494f-8325-4221c152c911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9e901f-c6b3-4840-ae33-2953c8e39eee", "tag": "27073afa-d48f-4e5f-b5fb-94c6c6f9082c"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:50.520875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-728b0736-fffa-4733-b163-0fdabf7d6519 req-325d8f51-5750-494f-8325-4221c152c911 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:50.523734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-728b0736-fffa-4733-b163-0fdabf7d6519 req-325d8f51-5750-494f-8325-4221c152c911 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:50.525855 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-728b0736-fffa-4733-b163-0fdabf7d6519 req-325d8f51-5750-494f-8325-4221c152c911 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:50.581484 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-728b0736-fffa-4733-b163-0fdabf7d6519 req-325d8f51-5750-494f-8325-4221c152c911 service nova] Creating event network-changed:27073afa-d48f-4e5f-b5fb-94c6c6f9082c for instance af9e901f-c6b3-4840-ae33-2953c8e39eee on hv-cinder-82869 Sep 09 14:57:50.597721 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-728b0736-fffa-4733-b163-0fdabf7d6519 req-325d8f51-5750-494f-8325-4221c152c911 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104779 Sep 09 14:57:50.598387 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 34/63] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 14:57:50.683457 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c786bf1b-24ca-44b5-8c8b-a9efe1585b1c req-9513c2e0-b080-4b39-97ee-d714d1db768d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1053d238-10c6-4e04-bb1c-10d883bab2a5", "name": "network-vif-plugged", "status": "completed", "tag": "acde1cfb-fe15-408e-9b75-038fe1bb658e"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:50.701623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:50.707585 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c786bf1b-24ca-44b5-8c8b-a9efe1585b1c req-9513c2e0-b080-4b39-97ee-d714d1db768d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:50.709817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c786bf1b-24ca-44b5-8c8b-a9efe1585b1c req-9513c2e0-b080-4b39-97ee-d714d1db768d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:50.711209 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c786bf1b-24ca-44b5-8c8b-a9efe1585b1c req-9513c2e0-b080-4b39-97ee-d714d1db768d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:50.714620 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:50.715388 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:50.730807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:50.733424 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:50.734096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:50.736472 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:50.738163 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:50.740366 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:50.752730 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c786bf1b-24ca-44b5-8c8b-a9efe1585b1c req-9513c2e0-b080-4b39-97ee-d714d1db768d service nova] Creating event network-vif-plugged:acde1cfb-fe15-408e-9b75-038fe1bb658e for instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 on hv-cinder-82869 Sep 09 14:57:50.766975 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c786bf1b-24ca-44b5-8c8b-a9efe1585b1c req-9513c2e0-b080-4b39-97ee-d714d1db768d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.451709 Sep 09 14:57:50.767653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 30/64] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:50.781587 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:50.784853 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:50.803149 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:50.803941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:50.804725 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:50.806056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:50.806961 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:50.810879 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:51.628213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:51.640018 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a8f46642-8319-4bbd-96bb-a959e67cabe2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1322 microversion: 2.1 time: 0.930656 Sep 09 14:57:51.641549 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 35/65] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:50 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1322 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:57:51.651953 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:51.659693 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:51.660322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:51.664950 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:51.667572 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:51.669384 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cee60a2b-5909-460e-9969-93629c2b785b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.899144 Sep 09 14:57:51.670393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 31/66] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:50 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:51.675329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:51.675834 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:51.676191 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:51.676298 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:51.677487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:51.680928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:51.681296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:51.681742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:51.685461 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:51.686243 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:51.686889 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:51.688073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:51.689338 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:51.690107 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:52.062421 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:52.067073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:52.070807 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92577764-656c-4210-b7b6-b79f85851b31 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 0.399140 Sep 09 14:57:52.072876 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 32/67] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:51 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:52.081267 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ff6f0372-7ea6-45b5-8baf-9d5459f50844 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1366 microversion: 2.1 time: 0.437160 Sep 09 14:57:52.097243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 36/68] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:51 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:52.672863 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:52.673505 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:52.683406 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:52.684023 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:52.685704 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:52.687171 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:52.688499 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:52.689166 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:52.706411 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:52.707778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:52.715141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:52.716286 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:52.717392 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:52.719297 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:52.720651 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:52.721502 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:52.977106 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:52.987356 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2de8e67-88f0-4e8f-bc76-f2750367ecca tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1322 microversion: 2.1 time: 0.325221 Sep 09 14:57:52.993737 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 33/69] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:52 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:52.999130 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-3131f1ec-57ab-4084-ba31-031ab8ba5913 req-841478a6-a886-4bfe-b5f1-2b9b49c3ccfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbddff0a-cdd3-4537-821e-decd3714e96d", "name": "network-vif-plugged", "status": "completed", "tag": "acf93c11-9610-4394-9769-af290e65bfdd"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:53.003588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:53.019376 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:53.021066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:53.022602 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a328d303-2f9e-4761-bd92-a6755eafbf23 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.328854 Sep 09 14:57:53.030265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 37/70] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:52 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:57:53.039736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3131f1ec-57ab-4084-ba31-031ab8ba5913 req-841478a6-a886-4bfe-b5f1-2b9b49c3ccfb service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:53.040234 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3131f1ec-57ab-4084-ba31-031ab8ba5913 req-841478a6-a886-4bfe-b5f1-2b9b49c3ccfb service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:53.040671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3131f1ec-57ab-4084-ba31-031ab8ba5913 req-841478a6-a886-4bfe-b5f1-2b9b49c3ccfb service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:53.052493 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-3131f1ec-57ab-4084-ba31-031ab8ba5913 req-841478a6-a886-4bfe-b5f1-2b9b49c3ccfb service nova] Creating event network-vif-plugged:acf93c11-9610-4394-9769-af290e65bfdd for instance fbddff0a-cdd3-4537-821e-decd3714e96d on hv-cinder-82869 Sep 09 14:57:53.059055 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-3131f1ec-57ab-4084-ba31-031ab8ba5913 req-841478a6-a886-4bfe-b5f1-2b9b49c3ccfb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063850 Sep 09 14:57:53.060058 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 34/71] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:53.094539 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:53.096151 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:53.103850 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:53.104639 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:53.105563 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:53.106467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:53.106924 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:53.107342 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:53.116152 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:53.119006 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:53.137518 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:53.139725 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:53.141340 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:53.141929 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:53.143441 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:53.146060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:53.356837 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:53.369178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1a534715-f322-4d76-8584-63af4dca762c tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1313 microversion: 2.1 time: 0.278557 Sep 09 14:57:53.371198 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 38/72] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:53 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:53.405821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:53.423481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eda0f165-fe98-4cb7-9ec5-6cc54c0e478a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1366 microversion: 2.1 time: 0.322724 Sep 09 14:57:53.424078 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 35/73] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:53 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:54.041040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:54.042116 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:54.054520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:54.057539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:54.064448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=5 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:54.065770 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:54.072373 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:54.073902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:54.075744 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:54.077689 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:54.078804 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:54.080635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:54.089230 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:54.093981 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:54.094519 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:54.105926 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:54.106512 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:54.106963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:54.675189 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:54.686746 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:54.687534 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:54.688749 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:54.690123 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e0c22da-cdf0-4ac3-9607-40ce37abbd3b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.646017 Sep 09 14:57:54.690790 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 36/74] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:54 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:57:54.695890 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:54.696797 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:54.705087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:54.705278 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d9e6e3d0-8cc2-4f67-8d3b-9dfbe1ca0a26 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1322 microversion: 2.1 time: 0.686147 Sep 09 14:57:54.705895 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:54.706518 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:54.707481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:54.708469 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:54.709089 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:54.715762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 39/75] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:54 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1322 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:54.728492 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:54.729468 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:54.738942 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:54.739873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:54.741095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:54.742594 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:54.744022 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:54.744854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:55.077711 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:55.084439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:55.092718 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f031fa3-8987-4e50-b51d-ad1e51181d2b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1500 microversion: 2.1 time: 0.400706 Sep 09 14:57:55.093405 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 37/76] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:54 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1500 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:55.094794 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d9375c9-1395-4421-a226-bfddd8529052 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1366 microversion: 2.1 time: 0.374503 Sep 09 14:57:55.108599 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 40/77] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:54 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:55.108962 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1721502931", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "networks": [{"uuid": "ea70958d-8611-435f-9904-c0efb2e3e5e6"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:55.186019 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-72566be3-19a7-4a36-99f3-4ff7e9ed7cd6 req-c6d8027a-4a15-4aff-a448-dbe7b13c02d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211a0b66-c743-4309-943c-b2d6afbee2c6", "name": "network-vif-plugged", "status": "completed", "tag": "c8fdd88c-0583-47e2-a5ed-5152bcef3474"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:55.202124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-72566be3-19a7-4a36-99f3-4ff7e9ed7cd6 req-c6d8027a-4a15-4aff-a448-dbe7b13c02d7 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:55.202299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] validate_networks() for [('ea70958d-8611-435f-9904-c0efb2e3e5e6', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:57:55.205313 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-72566be3-19a7-4a36-99f3-4ff7e9ed7cd6 req-c6d8027a-4a15-4aff-a448-dbe7b13c02d7 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:55.205985 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-72566be3-19a7-4a36-99f3-4ff7e9ed7cd6 req-c6d8027a-4a15-4aff-a448-dbe7b13c02d7 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:55.220584 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:55.232097 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-72566be3-19a7-4a36-99f3-4ff7e9ed7cd6 req-c6d8027a-4a15-4aff-a448-dbe7b13c02d7 service nova] Creating event network-vif-plugged:c8fdd88c-0583-47e2-a5ed-5152bcef3474 for instance 211a0b66-c743-4309-943c-b2d6afbee2c6 on hv-cinder-82869 Sep 09 14:57:55.238748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-72566be3-19a7-4a36-99f3-4ff7e9ed7cd6 req-c6d8027a-4a15-4aff-a448-dbe7b13c02d7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063803 Sep 09 14:57:55.239940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 41/78] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:55.717107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:55.717890 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:55.727930 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:55.728502 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:55.728956 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:55.730414 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:55.731173 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:55.731599 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:56.109407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:56.145982 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:56.147843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:56.149041 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d6b2aa61-fcc6-47d0-a183-d250a2dc970c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.436825 Sep 09 14:57:56.149732 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 42/79] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:55 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:57:56.155130 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:56.155813 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:56.159511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:57:56.159987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:57:56.160478 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:57:56.160945 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:57:56.161393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:57:56.173369 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:56.174287 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:56.174913 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:56.175790 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:56.176431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:56.176999 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:56.178413 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:56.178973 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:56.179471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:56.180589 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:56.182880 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:56.183546 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:56.198929 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Getting quotas for project bd3cfdafe89243748fe29bef991b2215. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:57:56.207923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Getting quotas for user ca360b149ac8402282733edfc4c67f9e and project bd3cfdafe89243748fe29bef991b2215. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:57:56.222473 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:57:56.227930 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:57:56.290699 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-130d8974-2072-42c0-a559-d0ba349b6a27 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.195081 Sep 09 14:57:56.291509 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 38/80] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 14:57:56.296706 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:56.301678 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:56.316377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:56.316883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:56.317360 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:56.318080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:56.318539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:56.318965 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:56.378092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:56.390968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b7f85592-b2c1-4a54-ac3b-3dc2b0509d00 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1322 microversion: 2.1 time: 0.239950 Sep 09 14:57:56.391867 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 43/81] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:56 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:56.396530 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37665044-7406-438d-bc68-285b5d7cbccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:56.397132 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37665044-7406-438d-bc68-285b5d7cbccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:56.496633 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37665044-7406-438d-bc68-285b5d7cbccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:56.511472 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37665044-7406-438d-bc68-285b5d7cbccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1214 microversion: 2.1 time: 0.117768 Sep 09 14:57:56.512794 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 44/82] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:56 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:56.528665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:56.537415 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e0d12f8-0255-4c9f-8b61-a26c508c36cf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1366 microversion: 2.1 time: 0.244573 Sep 09 14:57:56.553374 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 39/83] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:56 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:56.568231 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eed3686b-c6f9-4415-88eb-0d5cec67d085 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8db7c32a-950d-4865-91c7-de147a042770"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:56.570875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eed3686b-c6f9-4415-88eb-0d5cec67d085 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:56.592939 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eed3686b-c6f9-4415-88eb-0d5cec67d085 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:56.593681 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eed3686b-c6f9-4415-88eb-0d5cec67d085 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:56.609381 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eed3686b-c6f9-4415-88eb-0d5cec67d085 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:56.614894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eed3686b-c6f9-4415-88eb-0d5cec67d085 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:56.615278 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eed3686b-c6f9-4415-88eb-0d5cec67d085 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:56.615709 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eed3686b-c6f9-4415-88eb-0d5cec67d085 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.172777 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eed3686b-c6f9-4415-88eb-0d5cec67d085 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "POST /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.608367 Sep 09 14:57:57.173820 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 45/84] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 14:57:56 2022] POST /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5/os-volume_attachments => generated 194 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:57.185147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:57.185821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:57.207093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.207797 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.208412 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.209351 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.210404 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.211013 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.297648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=8 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:57.301881 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-7459a793-e521-48d6-a268-ca3e25d98d0f req-ee5b54fb-3955-40c4-b0d4-f069decd19b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c93a5b-944b-43a7-95f6-e49c229603b6", "name": "network-vif-plugged", "status": "completed", "tag": "17769411-6be9-4b42-9e21-4af2ee1d89cc"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:57.327027 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7459a793-e521-48d6-a268-ca3e25d98d0f req-ee5b54fb-3955-40c4-b0d4-f069decd19b3 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.327517 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7459a793-e521-48d6-a268-ca3e25d98d0f req-ee5b54fb-3955-40c4-b0d4-f069decd19b3 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.327954 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7459a793-e521-48d6-a268-ca3e25d98d0f req-ee5b54fb-3955-40c4-b0d4-f069decd19b3 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.351743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-7459a793-e521-48d6-a268-ca3e25d98d0f req-ee5b54fb-3955-40c4-b0d4-f069decd19b3 service nova] Creating event network-vif-plugged:17769411-6be9-4b42-9e21-4af2ee1d89cc for instance 70c93a5b-944b-43a7-95f6-e49c229603b6 on hv-cinder-82869 Sep 09 14:57:57.371906 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-7459a793-e521-48d6-a268-ca3e25d98d0f req-ee5b54fb-3955-40c4-b0d4-f069decd19b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075683 Sep 09 14:57:57.372743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 46/85] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 14:57:57.398697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:57.408031 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:57.409745 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:57.411083 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4404126-103b-4efc-9382-ba4a73158cf9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.233613 Sep 09 14:57:57.412006 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 40/86] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:57 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:57.417702 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:57.418585 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:57.425329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.427878 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.428394 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.429762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.430679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.431590 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.540139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:57.541052 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:57.554582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.556705 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.557605 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.560310 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.561090 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.561774 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.645680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:57.655493 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-31ccb7b4-55dd-4977-8ce6-da537bd0de4f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1515 microversion: 2.1 time: 0.242108 Sep 09 14:57:57.669230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 47/87] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:57 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:57.669230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:57.669230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:57.676745 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:57.681340 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.681841 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.682281 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.682991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.683447 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.683907 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.686613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e2ed5a4-cc3a-41ab-b252-69c02b2cfb62 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1210 microversion: 2.1 time: 0.151912 Sep 09 14:57:57.692036 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 41/88] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:57 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:57.703810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:57.709916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:57.722475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.722977 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.723416 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.724165 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:57.724563 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:57.724989 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:57.818714 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lazy-loading 'flavor' on Instance uuid 211a0b66-c743-4309-943c-b2d6afbee2c6 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 14:57:57.989314 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:58.002042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-12d8f157-1bdc-4365-a390-50c4bb46bee8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1366 microversion: 2.1 time: 0.343789 Sep 09 14:57:58.005303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 48/89] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:57 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:58.085131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0e35b68-08e4-4a4e-bc8e-209e1d78a9d8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6/action" status: 200 len: 32 microversion: 2.1 time: 0.388503 Sep 09 14:57:58.089665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 42/90] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 14:57:57 2022] POST /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6/action => generated 32 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 14:57:58.099711 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:58.100742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:58.107954 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:58.108513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:58.109590 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:58.110371 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:58.111043 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:58.111478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:58.444975 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:58.445716 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:58.452410 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:58.453050 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:58.453536 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:58.454229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:58.454684 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:58.455281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:58.491645 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:58.504751 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88959195-21ba-4f6d-9fbe-22708453b71c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.411554 Sep 09 14:57:58.505800 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 49/91] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:58 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:58.631327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:58.635482 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:58.642034 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:58.643462 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:58.644572 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8a3e061-e6ce-44a9-9cfe-ab9b1f82622c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.204724 Sep 09 14:57:58.645133 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 43/92] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:58 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:57:58.710649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:58.711316 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:58.717409 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:58.717898 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:58.718331 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:58.719015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:58.719465 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:58.719893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:58.804617 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:58.812909 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-310cea1c-b2b3-4b34-b322-0cd1fa447b29 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1266 microversion: 2.1 time: 0.106234 Sep 09 14:57:58.813747 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 50/93] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:58 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:59.026609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:59.027217 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:59.033919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:59.034413 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:59.034994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:59.035682 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:59.036132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:59.036554 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:59.211359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:59.219221 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58c2b878-fd5e-4265-9f51-27ce77199aaf tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1366 microversion: 2.1 time: 0.196632 Sep 09 14:57:59.219803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 44/94] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:59 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:57:59.386576 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-9b20a508-dd55-4fc8-983c-d7b021f299a6 req-648a0c8f-4481-4f4e-9bb1-95886ea8b857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9e901f-c6b3-4840-ae33-2953c8e39eee", "name": "network-vif-plugged", "status": "completed", "tag": "27073afa-d48f-4e5f-b5fb-94c6c6f9082c"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:57:59.397569 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-9b20a508-dd55-4fc8-983c-d7b021f299a6 req-648a0c8f-4481-4f4e-9bb1-95886ea8b857 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:59.398168 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-9b20a508-dd55-4fc8-983c-d7b021f299a6 req-648a0c8f-4481-4f4e-9bb1-95886ea8b857 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:59.398660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-9b20a508-dd55-4fc8-983c-d7b021f299a6 req-648a0c8f-4481-4f4e-9bb1-95886ea8b857 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:59.409877 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-9b20a508-dd55-4fc8-983c-d7b021f299a6 req-648a0c8f-4481-4f4e-9bb1-95886ea8b857 service nova] Creating event network-vif-plugged:27073afa-d48f-4e5f-b5fb-94c6c6f9082c for instance af9e901f-c6b3-4840-ae33-2953c8e39eee on hv-cinder-82869 Sep 09 14:57:59.414761 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-9b20a508-dd55-4fc8-983c-d7b021f299a6 req-648a0c8f-4481-4f4e-9bb1-95886ea8b857 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032618 Sep 09 14:57:59.415438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 51/95] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:57:59.539706 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:59.540355 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:59.551643 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:59.557539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:59.560862 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:59.561548 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:59.564308 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:59.564932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:59.674907 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:57:59.676198 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:57:59.692222 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:59.693082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:59.693950 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:59.696361 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:57:59.698329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:57:59.699979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:57:59.983285 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:57:59.991175 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef65a70a-835b-4cc2-9629-f12ba7acb5e4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.456368 Sep 09 14:57:59.991754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 45/96] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:59 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:00.001546 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:00.002155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:00.026057 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:00.026367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:00.027572 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:00.028402 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:00.028855 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:00.029307 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:00.029651 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:00.040395 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:00.042013 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:00.043161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ed80a5b-6a9c-4092-be39-107cb4667e52 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.374936 Sep 09 14:58:00.043818 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 52/97] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:57:59 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:58:00.100589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:00.111422 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-365554dc-bbfd-4a85-883f-4531d912a273 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1284 microversion: 2.1 time: 0.118159 Sep 09 14:58:00.111996 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 46/98] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:57:59 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:00.245914 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:00.246562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:00.252621 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:00.253092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:00.253564 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:00.254264 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:00.254884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:00.255319 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:00.575993 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:00.584262 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed48bf08-4791-4bdd-acf0-b3b8820b5403 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1366 microversion: 2.1 time: 0.342167 Sep 09 14:58:00.585102 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 53/99] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:00 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:01.031828 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:01.032398 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:01.038710 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:01.039389 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:01.039974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:01.040817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:01.041458 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:01.042062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:01.069125 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:01.069785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:01.085052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:01.085582 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:01.086023 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:01.086920 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:01.087907 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:01.088494 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:01.362254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:01.365482 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:01.376763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66646bf1-a5e1-4d6e-8da7-875b0c4bfd4b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.359782 Sep 09 14:58:01.383809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:01.387147 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:01.388619 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3e4403da-d81f-4d13-ae0f-b387abf593ce tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1406 microversion: 2.20 time: 0.324137 Sep 09 14:58:01.389715 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 54/100] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:58:01 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:58:01.395778 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 47/101] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:01 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:01.398734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:01.399484 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:01.412570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:01.413804 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:01.414255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:01.415510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:01.417167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:01.420088 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:01.612964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:01.614014 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:01.621946 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:01.622717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:01.623307 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:01.624168 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:01.633824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:01.640881 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:01.695431 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:01.710363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-23cdc961-4cfe-4a53-a7a6-7a8c5582ce98 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.319005 Sep 09 14:58:01.711190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 55/102] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:01 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:02.222687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:02.232298 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b16aaec-55c0-4cf5-ae96-53ae5aaa5ec5 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1555 microversion: 2.1 time: 0.627485 Sep 09 14:58:02.233818 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 48/103] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:01 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1555 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:02.257925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d9b3d54-c817-416b-b26e-8d4b7de559f0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:02.259252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d9b3d54-c817-416b-b26e-8d4b7de559f0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:02.266544 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d54-c817-416b-b26e-8d4b7de559f0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.267419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d54-c817-416b-b26e-8d4b7de559f0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.268008 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d54-c817-416b-b26e-8d4b7de559f0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:02.268905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d54-c817-416b-b26e-8d4b7de559f0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.269386 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d54-c817-416b-b26e-8d4b7de559f0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.269978 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d54-c817-416b-b26e-8d4b7de559f0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:02.414327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:02.415085 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:02.430097 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.430767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.431810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:02.432978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.434014 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.434824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:02.456445 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d9b3d54-c817-416b-b26e-8d4b7de559f0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203667 Sep 09 14:58:02.458151 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 56/104] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 14:58:02 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:02.465590 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:02.466473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:02.476532 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.481873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.482894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:02.483608 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.484225 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.512799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:02.801633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:02.816861 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef59c1ab-538f-40e6-a68e-c70b28c4c8e5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.412791 Sep 09 14:58:02.820931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 49/105] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:02 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:02.837654 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:02.842476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:02.844026 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:02.845882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:02.846274 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:02.847694 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c0941fb8-6588-4e42-8cd3-ecb23bfabc03 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1599 microversion: 2.20 time: 0.388251 Sep 09 14:58:02.848453 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 57/106] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:58:02 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1599 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:58:02.857427 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.858026 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.858466 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:02.859313 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.859762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.860580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:02.878359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cf929892-d99d-423c-bd54-cfbb6e1526d8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:02.878848 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cf929892-d99d-423c-bd54-cfbb6e1526d8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:02.890334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf929892-d99d-423c-bd54-cfbb6e1526d8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.890827 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf929892-d99d-423c-bd54-cfbb6e1526d8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.891265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf929892-d99d-423c-bd54-cfbb6e1526d8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:02.891972 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf929892-d99d-423c-bd54-cfbb6e1526d8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:02.892422 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf929892-d99d-423c-bd54-cfbb6e1526d8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:02.892845 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf929892-d99d-423c-bd54-cfbb6e1526d8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:03.189723 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cf929892-d99d-423c-bd54-cfbb6e1526d8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.315693 Sep 09 14:58:03.190848 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 58/107] 10.222.0.15 () {60 vars in 1316 bytes} [Fri Sep 9 14:58:02 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-interface => generated 285 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:58:03.196961 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-4f1138f3-73de-4fc1-ae6f-4df92aaf9002 req-885e7790-2ceb-4507-8a9c-183e9df11ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ec8731-c914-4a62-87f8-eb449219e741", "tag": "38a82255-0842-4e1d-ac54-27d11c73148c"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:03.218189 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:03.222606 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-4f1138f3-73de-4fc1-ae6f-4df92aaf9002 req-885e7790-2ceb-4507-8a9c-183e9df11ccd service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:03.223082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-4f1138f3-73de-4fc1-ae6f-4df92aaf9002 req-885e7790-2ceb-4507-8a9c-183e9df11ccd service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:03.223499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-4f1138f3-73de-4fc1-ae6f-4df92aaf9002 req-885e7790-2ceb-4507-8a9c-183e9df11ccd service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:03.254785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-4f1138f3-73de-4fc1-ae6f-4df92aaf9002 req-885e7790-2ceb-4507-8a9c-183e9df11ccd service nova] Creating event network-changed:38a82255-0842-4e1d-ac54-27d11c73148c for instance 84ec8731-c914-4a62-87f8-eb449219e741 on hv-cinder-82869 Sep 09 14:58:03.271015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-4f1138f3-73de-4fc1-ae6f-4df92aaf9002 req-885e7790-2ceb-4507-8a9c-183e9df11ccd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078639 Sep 09 14:58:03.273185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 59/108] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:03.403277 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:03.411162 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4278a137-b834-4565-84ec-3361fca59ef8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.588262 Sep 09 14:58:03.425581 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 50/109] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:02 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:03.846669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:03.847481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:03.876011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:03.876662 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:03.877934 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:03.878959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:03.879578 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:03.880009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:04.443012 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:04.444181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:04.483351 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:04.488436 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:04.489798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:04.490691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:04.494357 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:04.497120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:04.661509 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:04.666909 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:04.675995 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-74e124a0-226e-499a-a6e7-dd05e045b3cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.833693 Sep 09 14:58:04.677592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 60/110] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:03 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:04.683839 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-985fabbc-255a-4e5d-bce0-5ba9a3a0f501 req-9b1cbe3f-372b-4275-ba19-3bcfb8e57d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c93a5b-944b-43a7-95f6-e49c229603b6", "tag": "17769411-6be9-4b42-9e21-4af2ee1d89cc"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:04.695860 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-985fabbc-255a-4e5d-bce0-5ba9a3a0f501 req-9b1cbe3f-372b-4275-ba19-3bcfb8e57d54 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:04.696678 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-985fabbc-255a-4e5d-bce0-5ba9a3a0f501 req-9b1cbe3f-372b-4275-ba19-3bcfb8e57d54 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:04.697370 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-985fabbc-255a-4e5d-bce0-5ba9a3a0f501 req-9b1cbe3f-372b-4275-ba19-3bcfb8e57d54 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:04.730263 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-985fabbc-255a-4e5d-bce0-5ba9a3a0f501 req-9b1cbe3f-372b-4275-ba19-3bcfb8e57d54 service nova] Creating event network-changed:17769411-6be9-4b42-9e21-4af2ee1d89cc for instance 70c93a5b-944b-43a7-95f6-e49c229603b6 on hv-cinder-82869 Sep 09 14:58:04.735346 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-985fabbc-255a-4e5d-bce0-5ba9a3a0f501 req-9b1cbe3f-372b-4275-ba19-3bcfb8e57d54 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056309 Sep 09 14:58:04.737354 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 61/111] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:04.902583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:04.914539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9485d9b2-4721-4873-a96f-e192012d6797 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.477375 Sep 09 14:58:04.915958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 51/112] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:04 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:05.376748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-67de4eb8-bfcc-4765-8a6c-f7baa0bcc65d req-ea1fbddd-ec1c-43d0-b514-3737aafd3b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9e901f-c6b3-4840-ae33-2953c8e39eee", "tag": "27073afa-d48f-4e5f-b5fb-94c6c6f9082c"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:05.389009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-67de4eb8-bfcc-4765-8a6c-f7baa0bcc65d req-ea1fbddd-ec1c-43d0-b514-3737aafd3b50 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:05.389772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-67de4eb8-bfcc-4765-8a6c-f7baa0bcc65d req-ea1fbddd-ec1c-43d0-b514-3737aafd3b50 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:05.390460 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-67de4eb8-bfcc-4765-8a6c-f7baa0bcc65d req-ea1fbddd-ec1c-43d0-b514-3737aafd3b50 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:05.402734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-67de4eb8-bfcc-4765-8a6c-f7baa0bcc65d req-ea1fbddd-ec1c-43d0-b514-3737aafd3b50 service nova] Creating event network-changed:27073afa-d48f-4e5f-b5fb-94c6c6f9082c for instance af9e901f-c6b3-4840-ae33-2953c8e39eee on hv-cinder-82869 Sep 09 14:58:05.407542 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-67de4eb8-bfcc-4765-8a6c-f7baa0bcc65d req-ea1fbddd-ec1c-43d0-b514-3737aafd3b50 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034874 Sep 09 14:58:05.408338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 62/113] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 14:58:05.713514 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:05.716817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:05.747682 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:05.748186 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:05.748625 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:05.749364 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:05.750127 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:05.750561 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:05.939427 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:05.940822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:05.951681 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:05.954579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:05.955916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:05.959958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:05.960837 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:05.961558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:06.007202 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:06.026997 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b854a48-5df4-4be6-95e0-b8a6a268ab93 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.323806 Sep 09 14:58:06.027821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 52/114] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:05 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:06.211857 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:06.222148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bfccd0a5-fca0-4acc-ae13-696807fab1b6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.286654 Sep 09 14:58:06.223794 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 63/115] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:05 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:07.058077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:07.059472 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:07.061806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:07.062596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:07.068447 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:07.068950 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:07.069425 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:07.070136 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:07.070588 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:07.071206 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:07.226814 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:07.235394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50a5a9f4-0cbf-426a-a0f0-551992ce893c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.181628 Sep 09 14:58:07.249614 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 53/116] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:07 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:07.253774 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:07.254405 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:07.258859 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:07.263351 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:07.263852 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:07.264296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:07.265036 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:07.265567 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:07.265990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:07.451930 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:07.460961 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1dd8548d-257d-4447-a8b5-46f62903f28d tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.213947 Sep 09 14:58:07.474845 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 64/117] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:07 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:08.259654 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:08.260313 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:08.266786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:08.267268 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:08.267698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:08.268385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:08.268835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:08.269282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:08.487040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:08.487713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:08.498560 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:08.499047 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:08.499479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:08.500193 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:08.507571 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:08.517804 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:08.601806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:08.611155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94a7df5d-502c-433b-816c-182a1f6d3cd6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.355178 Sep 09 14:58:08.611918 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 54/118] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:08 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:09.115248 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:09.127059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4c85d03e-be9b-41b2-b86c-798f71240fc7 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.644190 Sep 09 14:58:09.142428 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 65/119] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:08 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:09.509056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:09.509982 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:09.518329 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:09.519163 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:09.519754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:09.520605 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:09.521099 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:09.521547 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:09.551503 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 14:58:09.634274 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:09.635708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:09.642427 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:09.643167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:09.643760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:09.644623 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:09.645255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:09.645853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:09.647251 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c98423f-2c3f-42ff-a137-c8e4b74065e7 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 204 len: 0 microversion: 2.1 time: 0.141747 Sep 09 14:58:09.651967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 55/120] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 14:58:09 2022] DELETE /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 14:58:09.659395 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:09.660088 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:09.666170 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:09.666651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:09.667827 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:09.668525 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:09.668972 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:09.669385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:09.873168 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:09.876960 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:09.884278 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8c603cab-9519-41d6-a528-b8205af521f2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.253682 Sep 09 14:58:09.885275 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 66/121] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:09 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:09.888759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d6257ae-045e-46d9-b018-2476592dead1 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1552 microversion: 2.1 time: 0.235295 Sep 09 14:58:09.889359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 56/122] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:09 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1552 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:10.149126 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:10.149772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:10.155929 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:10.156408 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:10.156840 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:10.157555 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:10.158003 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:10.158421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:10.300280 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:10.308365 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f4991383-2df0-49af-b94f-b4bc7c2789d6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.162590 Sep 09 14:58:10.308938 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 67/123] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:10 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:10.913623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:10.914486 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:10.914853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:10.915493 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:10.922731 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:10.922892 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:10.923402 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:10.923567 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:10.923905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:10.924206 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:10.924604 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:10.925483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:10.925713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:10.926333 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:10.926754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:10.926891 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:11.146679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:11.152979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:11.158235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67bedc63-b1ec-4fef-9069-bd9a1ffea023 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1552 microversion: 2.1 time: 0.249451 Sep 09 14:58:11.159175 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 57/124] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:10 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1552 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:11.182302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-08943c45-5b81-47cb-96c6-85583650cb9e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.271107 Sep 09 14:58:11.183160 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 68/125] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:10 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:11.334188 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:11.334800 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:11.342833 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:11.343526 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:11.343985 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:11.344688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:11.345455 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:11.346477 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:11.489665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:11.493121 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:11.497872 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a9cfc3d7-bc0a-46f4-9902-935a3900e5bc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.169989 Sep 09 14:58:11.498442 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 58/126] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:11 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:12.187742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:12.188717 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:12.195290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:12.195773 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:12.196481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:12.197352 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:12.197824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:12.198454 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:12.210792 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:12.211997 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:12.229105 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:12.230457 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:12.231281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:12.231951 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:12.233295 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:12.234599 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:12.561671 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:12.575589 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-66c932a4-944c-41e7-8a7e-fe5d6bf70687 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1552 microversion: 2.1 time: 0.393283 Sep 09 14:58:12.577151 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 69/127] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:12 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1552 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:12.589584 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:12.589584 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:12.590806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:12.591338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:12.591899 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:12.593087 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:12.593644 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:12.594459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:12.605098 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:12.613922 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80143894-8411-4d1a-9317-4a46cd26dc79 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.411829 Sep 09 14:58:12.614757 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 59/128] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:12 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:12.865470 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:12.874752 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8b51abc1-f415-4a66-aa1a-bb8202f98b36 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.296435 Sep 09 14:58:12.875963 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 70/129] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:12 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:13.065978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-146cba46-73fd-41fd-8be2-20c17541349a req-97e4da53-3790-4d60-ae3b-e2753108cc6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ec8731-c914-4a62-87f8-eb449219e741", "name": "network-vif-plugged", "status": "completed", "tag": "38a82255-0842-4e1d-ac54-27d11c73148c"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:13.087900 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-146cba46-73fd-41fd-8be2-20c17541349a req-97e4da53-3790-4d60-ae3b-e2753108cc6d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:13.088427 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-146cba46-73fd-41fd-8be2-20c17541349a req-97e4da53-3790-4d60-ae3b-e2753108cc6d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:13.089550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-146cba46-73fd-41fd-8be2-20c17541349a req-97e4da53-3790-4d60-ae3b-e2753108cc6d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:13.110304 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-358a6dcf-d342-4a52-a627-32c0842e4640 req-d3f1e8cd-a851-4564-ae3f-e1a528dbba89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1053d238-10c6-4e04-bb1c-10d883bab2a5", "name": "network-vif-deleted", "tag": "acde1cfb-fe15-408e-9b75-038fe1bb658e"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:13.131925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-358a6dcf-d342-4a52-a627-32c0842e4640 req-d3f1e8cd-a851-4564-ae3f-e1a528dbba89 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:13.132745 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-358a6dcf-d342-4a52-a627-32c0842e4640 req-d3f1e8cd-a851-4564-ae3f-e1a528dbba89 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:13.133386 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-358a6dcf-d342-4a52-a627-32c0842e4640 req-d3f1e8cd-a851-4564-ae3f-e1a528dbba89 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:13.146050 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-146cba46-73fd-41fd-8be2-20c17541349a req-97e4da53-3790-4d60-ae3b-e2753108cc6d service nova] Creating event network-vif-plugged:38a82255-0842-4e1d-ac54-27d11c73148c for instance 84ec8731-c914-4a62-87f8-eb449219e741 on hv-cinder-82869 Sep 09 14:58:13.160660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-146cba46-73fd-41fd-8be2-20c17541349a req-97e4da53-3790-4d60-ae3b-e2753108cc6d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107393 Sep 09 14:58:13.164882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 60/130] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:13.173691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-358a6dcf-d342-4a52-a627-32c0842e4640 req-d3f1e8cd-a851-4564-ae3f-e1a528dbba89 service nova] Creating event network-vif-deleted:acde1cfb-fe15-408e-9b75-038fe1bb658e for instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 on hv-cinder-82869 Sep 09 14:58:13.189692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-358a6dcf-d342-4a52-a627-32c0842e4640 req-d3f1e8cd-a851-4564-ae3f-e1a528dbba89 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082188 Sep 09 14:58:13.192022 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 71/131] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:13.601011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:13.602474 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:13.612653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:13.613646 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:13.614274 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:13.615494 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:13.616190 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:13.617087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:13.639874 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:13.640581 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:13.654713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:13.656168 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:13.657520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:13.661563 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:13.662202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:13.662833 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:13.698302 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:13.707451 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6f97e8e-ab4c-4ba4-90ae-f736460138ce tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1344 microversion: 2.1 time: 0.110756 Sep 09 14:58:13.708662 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 61/132] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:13 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:13.824369 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:13.833649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1228238c-b510-4d58-a928-10cc593dd42e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.199408 Sep 09 14:58:13.834981 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 72/133] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:13 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:13.902873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:13.903829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:13.915332 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:13.915902 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:13.916421 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:13.917779 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:13.918403 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:13.919004 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:14.100933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:14.109654 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6070d593-9f35-4848-be05-b367dff6ba66 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.213455 Sep 09 14:58:14.110240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 62/134] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:13 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:14.731112 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:14.731717 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:14.738544 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:14.739277 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:14.739899 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:14.740777 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:14.741430 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:14.742161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:14.783255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:14.783255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:14.783255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:14.783992 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lazy-loading 'fault' on Instance uuid 1053d238-10c6-4e04-bb1c-10d883bab2a5 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 14:58:14.858145 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:14.858964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:14.862956 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e123765a8724a89863d74221001dcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c2219444c1b4ad0a395880494ddbbe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:14.865139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:14.865973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:14.866611 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:14.867310 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:14.867910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:14.868518 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:14.879782 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e9e5ee5b-1aa9-4c6b-86f7-931ee52d3e40 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 200 len: 1349 microversion: 2.1 time: 0.152956 Sep 09 14:58:14.893224 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 73/135] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:14 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 1349 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:15.095766 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:15.104901 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa66d6a4-ce68-4041-8afc-ca7a87508dce tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.251095 Sep 09 14:58:15.105525 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 63/136] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:14 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:15.134407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:15.135438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:15.147367 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:15.148123 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:15.148792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:15.150621 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:15.152670 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:15.154614 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:15.336253 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:15.345046 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-db07e628-7741-4b54-8400-79e59226fd55 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1314 microversion: 2.1 time: 0.215720 Sep 09 14:58:15.345660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 74/137] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:15 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:15.910142 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:15.912023 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:15.922314 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:15.925286 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:15.925915 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:15.929141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:15.930286 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:15.933965 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:15.952939 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] HTTP exception thrown: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Request method failure captured: Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 HTTP/1.1 Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RNgmq5G25X0tsqrWbvcrcpK-lP6rHJ6IBU639jdnYL3c-k1jp-bov514TbAxK6DcEc83V3170bkdNjZefpasW8_zc_pE2uEnODVyVpgkmD49ZP34jts3P3_ftcxProYh7Kg01OHiya0G74b2n9GMstQBcv7l6JohhSacMy5zA0uKw Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 3c2219444c1b4ad0a395880494ddbbe3 Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 14:58:15.959104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c2219444c1b4ad0a395880494ddbbe3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3c2219444c1b4ad0a395880494ddbbe3 Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1896781641-project Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 1e123765a8724a89863d74221001dcd1 Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1896781641-project Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:15.960385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '1053d238-10c6-4e04-bb1c-10d883bab2a5'} Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:58:15.961087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:15.962341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:15.965015 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Returning 404 to user: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:58:15.966119 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5cc17f27-d838-441b-8dac-26ef2e77346e tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 404 len: 111 microversion: 2.1 time: 0.063156 Sep 09 14:58:15.967486 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 64/138] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:15 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 14:58:16.136660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:16.138172 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:16.138828 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:16.144910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:16.157694 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:16.158197 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:16.158647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:16.159363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:16.159829 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:16.160252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:16.162061 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:16.167459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:16.168077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:16.168967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:16.169453 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:16.169880 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:16.199370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] HTTP exception thrown: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Request method failure captured: Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5/os-volume_attachments HTTP/1.1 Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RNgmq5G25X0tsqrWbvcrcpK-lP6rHJ6IBU639jdnYL3c-k1jp-bov514TbAxK6DcEc83V3170bkdNjZefpasW8_zc_pE2uEnODVyVpgkmD49ZP34jts3P3_ftcxProYh7Kg01OHiya0G74b2n9GMstQBcv7l6JohhSacMy5zA0uKw Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 3c2219444c1b4ad0a395880494ddbbe3 Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 14:58:16.204463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c2219444c1b4ad0a395880494ddbbe3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3c2219444c1b4ad0a395880494ddbbe3 Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1896781641-project Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 1e123765a8724a89863d74221001dcd1 Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1896781641-project Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:16.206159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '1053d238-10c6-4e04-bb1c-10d883bab2a5'} Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:58:16.206821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:16.208022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:16.210610 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Returning 404 to user: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:58:16.210610 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3180281b-845c-4b5e-9d9b-b53b956e0d42 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.077453 Sep 09 14:58:16.212833 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 65/139] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 14:58:16 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5/os-volume_attachments => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 14:58:16.367653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:16.368461 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:16.379386 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:16.379878 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:16.382322 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:16.385323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:16.387296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:16.387722 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:16.460742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:16.482703 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a1a6e5b0-3a31-4f5b-a5f5-2ecc947fe370 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.355893 Sep 09 14:58:16.483689 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 75/140] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:16 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:16.611567 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:16.622106 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6060ea5-2f55-4a14-9471-a64072e595aa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1498 microversion: 2.1 time: 0.258431 Sep 09 14:58:16.622994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 66/141] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:16 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1498 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:17.249092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:17.249842 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:17.257114 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.257645 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.258088 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.258799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.259255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.259679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.287330 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 14:58:17.398436 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-159b2418-dca0-4702-9d35-6f3910404841 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "DELETE /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 204 len: 0 microversion: 2.1 time: 0.153446 Sep 09 14:58:17.399371 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 76/142] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 14:58:17 2022] DELETE /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 14:58:17.410126 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:17.411761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:17.419205 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.419779 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.420290 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.421060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.421736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.422502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.510799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:17.511799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:17.520087 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.520930 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.521535 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.522305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.522856 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.523366 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.545456 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:17.576556 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:17.584648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e8f0a0d-4590-40a2-934c-f8271d4d8595 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1504 microversion: 2.1 time: 0.179452 Sep 09 14:58:17.586043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 67/143] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:17 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:17.591014 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:17.591699 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:17.597960 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.598572 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.599108 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.599908 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.600565 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.601240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.616332 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] HTTP exception thrown: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Request method failure captured: Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 HTTP/1.1 Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RNgmq5G25X0tsqrWbvcrcpK-lP6rHJ6IBU639jdnYL3c-k1jp-bov514TbAxK6DcEc83V3170bkdNjZefpasW8_zc_pE2uEnODVyVpgkmD49ZP34jts3P3_ftcxProYh7Kg01OHiya0G74b2n9GMstQBcv7l6JohhSacMy5zA0uKw Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 3c2219444c1b4ad0a395880494ddbbe3 Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 14:58:17.618062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c2219444c1b4ad0a395880494ddbbe3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3c2219444c1b4ad0a395880494ddbbe3 Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1896781641-project Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 1e123765a8724a89863d74221001dcd1 Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1896781641-project Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.619238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '1053d238-10c6-4e04-bb1c-10d883bab2a5'} Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:58:17.620475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.621694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.623197 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Returning 404 to user: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:58:17.623197 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10e278ab-87c3-4184-be63-f8d86190ee0b tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 404 len: 111 microversion: 2.1 time: 0.032274 Sep 09 14:58:17.623197 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 68/144] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 14:58:17 2022] DELETE /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 14:58:17.630436 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:17.631216 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] [instance: 1053d238-10c6-4e04-bb1c-10d883bab2a5] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:17.638518 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.639020 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.639608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.640265 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:17.640818 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:17.641410 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:17.659494 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] HTTP exception thrown: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Request method failure captured: Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 HTTP/1.1 Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RNgmq5G25X0tsqrWbvcrcpK-lP6rHJ6IBU639jdnYL3c-k1jp-bov514TbAxK6DcEc83V3170bkdNjZefpasW8_zc_pE2uEnODVyVpgkmD49ZP34jts3P3_ftcxProYh7Kg01OHiya0G74b2n9GMstQBcv7l6JohhSacMy5zA0uKw Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 3c2219444c1b4ad0a395880494ddbbe3 Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 14:58:17.661215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c2219444c1b4ad0a395880494ddbbe3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c2219444c1b4ad0a395880494ddbbe3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3c2219444c1b4ad0a395880494ddbbe3 Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1896781641 Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1896781641-project Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 1e123765a8724a89863d74221001dcd1 Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1896781641-project Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.662378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '1053d238-10c6-4e04-bb1c-10d883bab2a5'} Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:58:17.663005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. Sep 09 14:58:17.664002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 14:58:17.665929 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] Returning 404 to user: Instance 1053d238-10c6-4e04-bb1c-10d883bab2a5 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:58:17.667578 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1e8730b8-c5f0-44df-bc42-53fe9090a903 tempest-DeleteServersTestJSON-1896781641 tempest-DeleteServersTestJSON-1896781641-project] 10.222.0.15 "GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5" status: 404 len: 111 microversion: 2.1 time: 0.041544 Sep 09 14:58:17.668576 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 69/145] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:17 2022] GET /compute/v2.1/servers/1053d238-10c6-4e04-bb1c-10d883bab2a5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 14:58:17.726759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:17.735905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-83a0fc01-25b9-4d20-864b-64a209283391 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.233364 Sep 09 14:58:17.736488 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 77/146] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:17 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:18.609466 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:18.610131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:18.612495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:18.625883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:18.629862 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:18.634120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:18.637607 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:18.638181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:18.638792 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:18.763367 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:18.763989 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:18.771906 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:18.777747 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:18.780428 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:18.783151 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:18.785330 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:18.790305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:18.956906 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:18.967744 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5667978e-0b02-40ad-86f4-a982649205d1 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1504 microversion: 2.1 time: 0.363014 Sep 09 14:58:18.970579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 70/147] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:18 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:19.011768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:19.022159 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cbd4f5d6-0028-4a50-b5d9-0edbb09ad341 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.263201 Sep 09 14:58:19.023211 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 78/148] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:18 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:19.728571 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-14454734-0ea8-498c-bc10-097a2588a036 req-cbfa6875-c5f2-4852-bc57-a2454d22ee37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ec8731-c914-4a62-87f8-eb449219e741", "name": "network-vif-deleted", "tag": "38a82255-0842-4e1d-ac54-27d11c73148c"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:19.751548 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-14454734-0ea8-498c-bc10-097a2588a036 req-cbfa6875-c5f2-4852-bc57-a2454d22ee37 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:19.752055 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-14454734-0ea8-498c-bc10-097a2588a036 req-cbfa6875-c5f2-4852-bc57-a2454d22ee37 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:19.754699 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-14454734-0ea8-498c-bc10-097a2588a036 req-cbfa6875-c5f2-4852-bc57-a2454d22ee37 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:19.776454 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-14454734-0ea8-498c-bc10-097a2588a036 req-cbfa6875-c5f2-4852-bc57-a2454d22ee37 service nova] Creating event network-vif-deleted:38a82255-0842-4e1d-ac54-27d11c73148c for instance 84ec8731-c914-4a62-87f8-eb449219e741 on hv-cinder-82869 Sep 09 14:58:19.785516 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-14454734-0ea8-498c-bc10-097a2588a036 req-cbfa6875-c5f2-4852-bc57-a2454d22ee37 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061113 Sep 09 14:58:19.787504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 71/149] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:19.999754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:20.000947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:20.007895 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:20.008425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:20.009878 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:20.011404 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:20.012465 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:20.013128 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:20.047741 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:20.048453 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:20.063414 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:20.063920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:20.064355 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:20.065413 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:20.065557 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:20.066280 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:20.066448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:20.067150 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:20.067668 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:20.068320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lazy-loading 'fault' on Instance uuid 84ec8731-c914-4a62-87f8-eb449219e741 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 14:58:20.113833 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:20.122141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b0387f2b-3507-4b2e-b156-37d512484a85 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 200 len: 1304 microversion: 2.1 time: 0.128895 Sep 09 14:58:20.123439 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 79/150] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:19 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:20.322056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:20.329947 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-31a60829-acc8-4b5c-a992-e5e83a16991a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.287045 Sep 09 14:58:20.331205 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 72/151] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:20 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:21.148252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:21.149047 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: 84ec8731-c914-4a62-87f8-eb449219e741] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:21.168156 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:21.168652 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:21.169092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:21.169838 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:21.170296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:21.170732 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:21.194804 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] HTTP exception thrown: Instance 84ec8731-c914-4a62-87f8-eb449219e741 could not be found. Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Request method failure captured: Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 HTTP/1.1 Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1Rw5sm_xwMZ72l3DceosfhufDzBuyJB8UMBeje2Fcn6DnGaZ4NEXk-WSsB7xHGD-jEFbL1JfhGpg3mjnNIqdFLT2--DJLrMYrv5HQQjPPl7W-C8AdLQ3Rdh07yVcA6VJ-4bV_uVEM41wXX8tYjt9wGnn5CEdBFZ0mW2IGoCeJRadJM Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: bd3cfdafe89243748fe29bef991b2215 Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesActionsTest-1377335741 Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 14:58:21.200243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd3cfdafe89243748fe29bef991b2215"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd3cfdafe89243748fe29bef991b2215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bd3cfdafe89243748fe29bef991b2215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bd3cfdafe89243748fe29bef991b2215", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesActionsTest-1377335741 Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: bd3cfdafe89243748fe29bef991b2215 Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesActionsTest-1377335741 Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesActionsTest-1377335741-project Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: ca360b149ac8402282733edfc4c67f9e Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesActionsTest-1377335741-project Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 84ec8731-c914-4a62-87f8-eb449219e741 could not be found. Sep 09 14:58:21.201421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '84ec8731-c914-4a62-87f8-eb449219e741'} Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ec8731-c914-4a62-87f8-eb449219e741 could not be found. Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:58:21.202106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ec8731-c914-4a62-87f8-eb449219e741 could not be found. Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ec8731-c914-4a62-87f8-eb449219e741 could not be found. Sep 09 14:58:21.203111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:21.204039 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Returning 404 to user: Instance 84ec8731-c914-4a62-87f8-eb449219e741 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:58:21.204039 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-58411a23-8aae-4ac8-814a-049250871ffa tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741" status: 404 len: 111 microversion: 2.1 time: 0.057357 Sep 09 14:58:21.233528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 80/152] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:21 2022] GET /compute/v2.1/servers/84ec8731-c914-4a62-87f8-eb449219e741 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 14:58:21.355648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:21.358459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:21.382653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:21.385381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:21.386623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:21.388225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:21.388964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:21.390902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1773159570", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "networks": [{"uuid": "ea70958d-8611-435f-9904-c0efb2e3e5e6"}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:21.391124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:21.477671 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] validate_networks() for [('ea70958d-8611-435f-9904-c0efb2e3e5e6', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:58:21.703928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:21.717605 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64ff05d2-ffc4-469d-80b2-017daac958fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.366745 Sep 09 14:58:21.720796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 73/153] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:21 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:22.219995 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:58:22.220453 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:58:22.221642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:58:22.222148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:58:22.222660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:58:22.234078 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:22.234665 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:22.235177 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:22.236088 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:22.236700 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:22.237313 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:22.264077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Getting quotas for project bd3cfdafe89243748fe29bef991b2215. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:58:22.271135 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Getting quotas for user ca360b149ac8402282733edfc4c67f9e and project bd3cfdafe89243748fe29bef991b2215. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:58:22.285876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:58:22.289446 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:58:22.357352 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-64182505-1fbe-478a-8188-b8d1c20144a2 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971360 Sep 09 14:58:22.358590 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 81/154] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:58:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 14:58:22.370303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-07429127-da31-4eeb-aaf3-0e6a3ad1938b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:22.371555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-07429127-da31-4eeb-aaf3-0e6a3ad1938b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:22.468677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-07429127-da31-4eeb-aaf3-0e6a3ad1938b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:22.479141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-07429127-da31-4eeb-aaf3-0e6a3ad1938b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1214 microversion: 2.1 time: 0.113347 Sep 09 14:58:22.482070 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 74/155] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:22 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:22.748267 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:22.749342 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:22.756186 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:22.757066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:22.758517 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:22.762226 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:22.763112 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:22.763705 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:23.031755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:23.042877 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1b0666da-e910-49f8-a6b2-84100b26039c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.298895 Sep 09 14:58:23.045568 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 82/156] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:22 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:23.503057 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:23.503995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:23.509973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:23.510562 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:23.511111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:23.511893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:23.512432 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:23.512886 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:23.577562 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:23.585270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a3daabe-6e58-40c0-a68b-fa17bba5bccc tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1218 microversion: 2.1 time: 0.086263 Sep 09 14:58:23.586043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 75/157] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:23 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:24.067680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:24.068873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:24.076680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:24.077404 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:24.078018 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:24.078720 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:24.079560 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:24.080199 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:24.226767 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:24.236363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-aefa332a-1131-4b1a-8f9c-c4b6f6d4cc72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.173513 Sep 09 14:58:24.237192 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 83/158] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:24 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:24.607815 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:24.608421 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:24.614415 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:24.614893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:24.615330 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:24.616010 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:24.616461 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:24.616880 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:24.695982 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:24.704817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1c633cf-8875-447c-a710-18ed0469a493 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1218 microversion: 2.1 time: 0.100899 Sep 09 14:58:24.705416 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 76/159] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:24 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:25.260273 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:25.261241 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:25.270204 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:25.270913 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:25.271674 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:25.272619 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:25.273289 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:25.274021 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:25.517076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:25.527023 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d671b0ef-1623-442d-90d9-4e128adc8f6e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.270051 Sep 09 14:58:25.527884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 84/160] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:25 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:25.728547 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:25.729705 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:25.736369 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:25.737154 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:25.737889 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:25.738738 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:25.739294 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:25.739841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:26.085279 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:26.094429 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d603605a-af97-4ee2-843f-7a72b80f49d8 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1266 microversion: 2.1 time: 0.369920 Sep 09 14:58:26.095152 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 77/161] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:25 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1266 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:26.550592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:26.567713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:26.578405 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:26.579221 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:26.579883 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:26.581024 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:26.581893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:26.582864 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:27.063245 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:27.083406 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3469cb74-65b0-4e8b-8c97-70f05ef53338 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.535259 Sep 09 14:58:27.087815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 85/162] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:26 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:27.123115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:27.125516 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:27.145616 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:27.145616 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:27.145616 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:27.145616 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:27.145959 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:27.145959 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:27.280013 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:27.288403 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20358188-09e6-4812-8571-faa9b156da84 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1272 microversion: 2.1 time: 0.172753 Sep 09 14:58:27.289497 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 78/163] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:27 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:28.111522 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:28.112463 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:28.120954 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:28.121760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:28.122347 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:28.123359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:28.124120 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:28.124766 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:28.312637 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:28.313837 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:28.321365 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:28.322361 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:28.322831 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:28.323628 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:28.324382 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:28.324997 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:28.509465 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:28.521153 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e803a41-8592-418d-82ec-4fbb73a6c005 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.413351 Sep 09 14:58:28.528288 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 86/164] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:28 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:28.589336 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:28.597241 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bdf1128-d5d4-478f-b4b0-f486e91c2a53 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1314 microversion: 2.1 time: 0.288390 Sep 09 14:58:28.598038 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 79/165] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:28 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:29.550287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:29.551354 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:29.561337 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:29.561986 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:29.562909 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:29.564274 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:29.564917 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:29.565749 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:29.620644 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:29.621341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:29.627418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:29.627851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:29.628284 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:29.628980 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:29.629630 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:29.629891 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:29.647912 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:29.950493 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:29.967479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-47a6a262-e52c-45e6-9d9e-a3d7b9d8f94d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.423903 Sep 09 14:58:29.968073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 87/166] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:29 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:30.027358 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:30.037144 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5138315-6c11-43e0-8602-5f340ebacfb5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1314 microversion: 2.1 time: 0.420805 Sep 09 14:58:30.037579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 80/167] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:29 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:30.202370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-01991547-1da8-4540-bba4-f72a7fb5b319 req-fe490f5b-1e51-49ff-b21f-6f6b2d0785be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c042e26f-d7fb-43e8-bfd8-03593ca28f37", "tag": "23ce82d0-5c18-43b4-9e09-9f06c9e97ebf"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:30.229679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-01991547-1da8-4540-bba4-f72a7fb5b319 req-fe490f5b-1e51-49ff-b21f-6f6b2d0785be service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:30.230257 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-01991547-1da8-4540-bba4-f72a7fb5b319 req-fe490f5b-1e51-49ff-b21f-6f6b2d0785be service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:30.231307 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-01991547-1da8-4540-bba4-f72a7fb5b319 req-fe490f5b-1e51-49ff-b21f-6f6b2d0785be service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:30.259218 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-01991547-1da8-4540-bba4-f72a7fb5b319 req-fe490f5b-1e51-49ff-b21f-6f6b2d0785be service nova] Creating event network-changed:23ce82d0-5c18-43b4-9e09-9f06c9e97ebf for instance c042e26f-d7fb-43e8-bfd8-03593ca28f37 on hv-cinder-82869 Sep 09 14:58:30.265612 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-01991547-1da8-4540-bba4-f72a7fb5b319 req-fe490f5b-1e51-49ff-b21f-6f6b2d0785be service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068208 Sep 09 14:58:30.266445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 81/168] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 14:58:30.326837 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-16bc014a-d15c-4c22-af08-a57011fa23bc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'create', calling method: .version_select at 0x7f8ad2b150d0>, body: {"keypair": {"name": "tempest-keypair-940244061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVNSv2ZfLH0yrIvinNiEGFUlau+qvAVm3aT2t0ZNmJSbcUHkrAANENirW+R79wIqUBtpeIQKv86Zrfn4NfvRZFQbXknVFcgTRNdVz28g3f91huLqkVGY1c36vgNjGQthw=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:30.357941 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-16bc014a-d15c-4c22-af08-a57011fa23bc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Getting quotas for project e498d32cc51a4bad9cb21e58985ce63e. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:58:30.363661 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-16bc014a-d15c-4c22-af08-a57011fa23bc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Getting quotas for user b72887db5ed34dbebe0d5745cf77c4a8 and project e498d32cc51a4bad9cb21e58985ce63e. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:58:30.406971 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-16bc014a-d15c-4c22-af08-a57011fa23bc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.281136 Sep 09 14:58:30.408174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 88/169] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 14:58:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:30.991807 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:30.992500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:31.001958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:31.002652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:31.003199 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:31.004042 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:31.004600 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:31.005131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:31.061990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:31.062656 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:31.069491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:31.070162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:31.070595 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:31.071485 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:31.072088 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:31.072719 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:31.333282 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:31.336683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:31.349282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79c03d59-e0d2-4833-adb4-ffed06175588 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.361536 Sep 09 14:58:31.350506 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1a1342e5-d3f4-4c3e-b422-757a816faae5 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1314 microversion: 2.1 time: 0.294532 Sep 09 14:58:31.362831 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 82/170] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:30 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:31.364381 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 89/171] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:31 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:32.305493 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-916614688", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdb8f25d-969f-4b3f-93fd-134c876a47c8"}], "security_groups": [{"name": "tempest-securitygroup--1826232613"}], "key_name": "tempest-keypair-940244061", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:32.374814 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:32.377026 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:32.389175 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:32.395042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:32.395865 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:32.396471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:32.397405 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:32.398018 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:32.398601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:32.475999 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:32.518464 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] validate_networks() for [('bdb8f25d-969f-4b3f-93fd-134c876a47c8', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:58:32.690320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:32.703913 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1677664b-0c44-4804-a118-d83465437310 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.332797 Sep 09 14:58:32.704492 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 90/172] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:32 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:32.712632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:32.713879 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:32.724802 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:32.725331 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:32.725780 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:32.726699 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:32.727164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:32.727538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:33.023190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:33.035106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cdd01838-5d4c-43ab-9ea8-14a7f2d13cee tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1314 microversion: 2.1 time: 0.328927 Sep 09 14:58:33.035910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 91/173] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:32 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:33.206401 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:58:33.206827 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:58:33.207307 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:58:33.207721 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:58:33.208127 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:58:33.218022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:33.218507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:33.218941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:33.219701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:33.220157 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:33.220580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:33.238039 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Getting quotas for project e498d32cc51a4bad9cb21e58985ce63e. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:58:33.242679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Getting quotas for user b72887db5ed34dbebe0d5745cf77c4a8 and project e498d32cc51a4bad9cb21e58985ce63e. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:58:33.255256 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:58:33.258149 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:58:33.321064 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fbc643cb-2e72-4dbf-9258-f9d40663081b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.020089 Sep 09 14:58:33.321850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 83/174] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:58:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 14:58:33.333629 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4fd95558-3612-4812-afa3-56bc6c7e982d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:33.334467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4fd95558-3612-4812-afa3-56bc6c7e982d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:33.337730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:33.404556 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4fd95558-3612-4812-afa3-56bc6c7e982d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:33.415810 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4fd95558-3612-4812-afa3-56bc6c7e982d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1236 microversion: 2.1 time: 0.085942 Sep 09 14:58:33.416496 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 92/175] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:33 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:33.728348 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:33.729269 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:33.735992 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:33.736757 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:33.737542 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:33.738602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:33.739204 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:33.739940 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:33.884318 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:33.892724 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3dc53c32-1ae4-4fd1-8e21-e831e1760c04 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.168715 Sep 09 14:58:33.893313 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 84/176] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:33 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:34.059574 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:34.060194 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:34.068583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:34.069318 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:34.069572 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:34.070303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:34.070754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:34.071173 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:34.264116 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:34.273570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f98591ad-d2a9-410d-99aa-1de77a14f988 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1314 microversion: 2.1 time: 0.218426 Sep 09 14:58:34.274703 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 93/177] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:34 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:34.438773 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:34.439388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:34.446560 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:34.447047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:34.448466 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:34.449178 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:34.449920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:34.450067 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:34.522952 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:34.531274 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc6cba17-3bd1-44ac-852b-ad62dd83448e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1240 microversion: 2.1 time: 0.096704 Sep 09 14:58:34.531840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 85/178] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:34 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:34.918032 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:34.919308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:34.929029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:34.930707 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:34.931392 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:34.932322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:34.933327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:34.934074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:35.283495 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:35.292065 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3328e398-43a7-4299-84ae-40172bc043ee tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.379642 Sep 09 14:58:35.306014 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 94/179] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:34 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:35.311178 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:35.311811 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:35.320338 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:35.320828 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:35.321284 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:35.321980 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:35.322431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:35.323369 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:35.537057 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:35.537057 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5af57221-1ad5-428a-82ec-1641bd2e7619 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1314 microversion: 2.1 time: 0.228179 Sep 09 14:58:35.537057 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 86/180] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:35 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:35.555352 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:35.556078 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:35.562610 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:35.563100 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:35.563671 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:35.564370 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:35.564817 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:35.565263 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:35.661749 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:35.685754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e874e513-dbce-4b90-bd72-96dab05957d3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1288 microversion: 2.1 time: 0.134483 Sep 09 14:58:35.687159 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 95/181] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:35 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1288 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:36.314903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:36.315490 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:36.326256 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:36.326948 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:36.327599 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:36.328461 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:36.331212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:36.331818 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:36.562532 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:36.563755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:36.580120 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:36.580635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:36.581084 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:36.587142 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:36.589816 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:36.590292 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:36.635726 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:36.652416 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b620fac-6eef-4ed3-abff-55305d759beb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.339298 Sep 09 14:58:36.665245 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 87/182] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:36 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:36.671766 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-5280edd9-4bf8-4777-aa0a-231cf0ce0015 req-c3f210b5-84c0-4425-9125-e6c90b95a90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c042e26f-d7fb-43e8-bfd8-03593ca28f37", "name": "network-vif-plugged", "status": "completed", "tag": "23ce82d0-5c18-43b4-9e09-9f06c9e97ebf"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:36.694287 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5280edd9-4bf8-4777-aa0a-231cf0ce0015 req-c3f210b5-84c0-4425-9125-e6c90b95a90c service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:36.695026 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5280edd9-4bf8-4777-aa0a-231cf0ce0015 req-c3f210b5-84c0-4425-9125-e6c90b95a90c service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:36.696656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5280edd9-4bf8-4777-aa0a-231cf0ce0015 req-c3f210b5-84c0-4425-9125-e6c90b95a90c service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:36.718861 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-5280edd9-4bf8-4777-aa0a-231cf0ce0015 req-c3f210b5-84c0-4425-9125-e6c90b95a90c service nova] Creating event network-vif-plugged:23ce82d0-5c18-43b4-9e09-9f06c9e97ebf for instance c042e26f-d7fb-43e8-bfd8-03593ca28f37 on hv-cinder-82869 Sep 09 14:58:36.739600 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-5280edd9-4bf8-4777-aa0a-231cf0ce0015 req-c3f210b5-84c0-4425-9125-e6c90b95a90c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080216 Sep 09 14:58:36.742435 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 88/183] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:36.756165 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:36.760679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:36.771241 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:36.771750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:36.772191 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:36.774340 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:36.777336 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:36.777966 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:36.965275 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:36.975542 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-feea5e1f-9645-4805-8731-9ac7fb0dcac3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1294 microversion: 2.1 time: 0.231582 Sep 09 14:58:36.995766 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 89/184] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:36 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1294 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:37.059812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:37.083567 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7ec5e1cd-06fa-4a24-a92c-d72e7b965098 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1314 microversion: 2.1 time: 0.521379 Sep 09 14:58:37.085279 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 96/185] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:36 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:37.680032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:37.680658 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:37.692543 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:37.693770 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:37.694378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:37.695103 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:37.695559 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:37.696523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:38.002801 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:38.003441 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:38.049791 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:38.053036 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:38.053559 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:38.056246 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:38.057516 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:38.058139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:38.058724 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:38.061250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43c9726c-9b81-4cda-b3e2-cb859a9f53fd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.387045 Sep 09 14:58:38.063686 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 90/186] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:37 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:38.064168 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:38.113633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:38.114316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:38.128800 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:38.129690 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:38.130457 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:38.131627 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:38.132806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:38.133748 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:38.752776 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:38.787805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-378940fe-43b9-42dc-81ae-4b31a84add50 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.777456 Sep 09 14:58:38.789677 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 97/187] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:37 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:38.872572 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:38.892325 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ddd39f0-2623-4278-92ae-52422d600757 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1314 microversion: 2.1 time: 0.783940 Sep 09 14:58:38.893573 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 91/188] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:38 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:39.037727 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-7a6fa508-9769-48ca-98b5-47eb1ba3bc34 req-c3cca19a-cf42-4b09-8f20-399e73055f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762529ff-2c14-4d96-85cb-3908b1f9e26b", "tag": "112e83fe-adcc-47b0-8085-50326186abe9"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:39.065751 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7a6fa508-9769-48ca-98b5-47eb1ba3bc34 req-c3cca19a-cf42-4b09-8f20-399e73055f97 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:39.067244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7a6fa508-9769-48ca-98b5-47eb1ba3bc34 req-c3cca19a-cf42-4b09-8f20-399e73055f97 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:39.068413 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7a6fa508-9769-48ca-98b5-47eb1ba3bc34 req-c3cca19a-cf42-4b09-8f20-399e73055f97 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:39.085978 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-7a6fa508-9769-48ca-98b5-47eb1ba3bc34 req-c3cca19a-cf42-4b09-8f20-399e73055f97 service nova] Creating event network-changed:112e83fe-adcc-47b0-8085-50326186abe9 for instance 762529ff-2c14-4d96-85cb-3908b1f9e26b on hv-cinder-82869 Sep 09 14:58:39.086469 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:39.087337 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:39.091943 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-7a6fa508-9769-48ca-98b5-47eb1ba3bc34 req-c3cca19a-cf42-4b09-8f20-399e73055f97 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057982 Sep 09 14:58:39.093080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 98/189] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:39.095497 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:39.099005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:39.102555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:39.107221 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:39.108914 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:39.109648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:39.338506 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:39.347476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1e5522f-e1fc-4a85-9a9c-9d9a1b662ecc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.265032 Sep 09 14:58:39.348931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 92/190] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:39 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:39.816439 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:39.817538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:39.827600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:39.828443 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:39.829122 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:39.830273 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:39.831409 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:39.832394 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:39.922013 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:39.923509 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:39.936069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:39.936978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:39.938320 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:39.939611 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:39.940928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:39.941654 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:40.138228 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:40.167883 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-04a7efaf-e890-4889-a404-429d94791de6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.355648 Sep 09 14:58:40.181402 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 99/191] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:39 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:40.193481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:40.203315 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-478aac5a-f8d6-428a-ac10-9fc907a8ef48 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1498 microversion: 2.1 time: 0.290318 Sep 09 14:58:40.205275 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 93/192] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:39 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1498 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:40.372635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:40.373516 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:40.388458 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:40.389140 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:40.389794 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:40.390691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:40.391309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:40.391880 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:40.708857 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:40.717434 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-72789a05-627c-4185-ad38-a9730cb62a25 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.349293 Sep 09 14:58:40.718717 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 100/193] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:40 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:41.206832 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:41.207668 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:41.215231 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:41.215724 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:41.216158 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:41.216855 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:41.217331 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:41.217749 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:41.384827 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:41.395888 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26591970-25cd-4eef-bc69-698eb9ea53ee tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.192692 Sep 09 14:58:41.396643 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 94/194] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:41 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:41.742311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:41.743884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:41.752974 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:41.753817 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:41.754490 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:41.755538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:41.756160 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:41.756742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:42.171225 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:42.183378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9bcfe0bb-1d9f-4c9c-84bc-5cfd6b5aa707 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.442330 Sep 09 14:58:42.184302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 101/195] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:41 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:42.359790 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:42.360956 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:42.368178 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:42.369083 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:42.370413 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:42.371449 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:42.372225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:42.372845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:42.421237 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:42.422287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:42.438871 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:42.439667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:42.441738 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:42.450049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:42.450744 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:42.451363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:42.453391 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 14:58:42.647075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01c69d66-fac2-457e-9e20-60dac4a43563 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 204 len: 0 microversion: 2.1 time: 0.290273 Sep 09 14:58:42.648396 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 95/196] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 14:58:42 2022] DELETE /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 14:58:42.681783 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:42.683798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:42.709946 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:42.710450 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:42.712803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:42.716338 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:42.717009 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:42.718575 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:42.818956 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:42.829085 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fd3ab480-a044-4d2a-975b-f75be040e237 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.412919 Sep 09 14:58:42.832918 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 102/197] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:42 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:42.954457 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:42.965851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fad0e224-20f9-45eb-9c87-3bf6e8ca88f6 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1504 microversion: 2.1 time: 0.312031 Sep 09 14:58:42.981688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 96/198] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:42 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:43.208983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:43.210272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:43.222859 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:43.223868 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:43.225791 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:43.229089 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:43.230528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:43.232106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:43.413798 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=12 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:43.499298 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:43.509385 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e7b507b5-065a-4faa-bb66-16563a3a70ad tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.305888 Sep 09 14:58:43.522524 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 103/199] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:43 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:43.852557 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:43.854572 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:43.858153 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:43.859174 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:43.895112 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:43.901905 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:43.902560 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:43.903408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:43.903970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:43.904615 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:43.938613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:43.989169 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:43.989830 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:44.045049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:44.045988 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:44.046609 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:44.050414 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:44.051236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:44.051900 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:44.185278 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:44.208166 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8425e1f7-c72b-4e61-babe-ed6a4bf27fe5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.349643 Sep 09 14:58:44.235452 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 97/200] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:43 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:44.392883 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:44.412038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-93486037-f68f-429f-99ac-91d67ef76326 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1504 microversion: 2.1 time: 0.426890 Sep 09 14:58:44.428980 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 104/201] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:43 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:44.535854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:44.536463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:44.554203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:44.554825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:44.558397 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:44.563935 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:44.564564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:44.565016 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:45.067297 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:45.076656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ca9f344-0b03-4694-8a01-e82aa34eb148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.548032 Sep 09 14:58:45.077967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 98/202] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:44 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:45.239658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:45.241001 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:45.256551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:45.257181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:45.257882 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:45.258806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:45.259367 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:45.260025 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:45.440368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:45.441180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:45.452724 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:45.465786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:45.467297 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:45.470840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:45.475651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:45.484910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:45.575239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:45.594154 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1cc3be2b-4dbd-469e-9ac9-63960e32c3c8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.355668 Sep 09 14:58:45.602756 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 105/203] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:45 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:45.755736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:45.766622 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7f85fb7-df5d-41b4-90e7-bdf46eb9713b tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1504 microversion: 2.1 time: 0.330337 Sep 09 14:58:45.773372 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 99/204] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:45 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:46.110086 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:46.111266 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:46.119189 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:46.121000 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:46.121811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:46.123067 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:46.123874 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:46.124580 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:46.505779 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:46.521540 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-05d3067b-5b99-46b7-a97b-e084127795f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.416979 Sep 09 14:58:46.522147 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 106/205] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:46 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:46.573513 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4e7db132-cd88-4d93-83cf-d1295dd408e8 req-696a516b-9ac1-4324-970e-6ad85455e19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c042e26f-d7fb-43e8-bfd8-03593ca28f37", "name": "network-vif-deleted", "tag": "23ce82d0-5c18-43b4-9e09-9f06c9e97ebf"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:46.589121 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e7db132-cd88-4d93-83cf-d1295dd408e8 req-696a516b-9ac1-4324-970e-6ad85455e19d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:46.592601 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e7db132-cd88-4d93-83cf-d1295dd408e8 req-696a516b-9ac1-4324-970e-6ad85455e19d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:46.593906 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e7db132-cd88-4d93-83cf-d1295dd408e8 req-696a516b-9ac1-4324-970e-6ad85455e19d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:46.629545 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:46.630816 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:46.640037 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4e7db132-cd88-4d93-83cf-d1295dd408e8 req-696a516b-9ac1-4324-970e-6ad85455e19d service nova] Creating event network-vif-deleted:23ce82d0-5c18-43b4-9e09-9f06c9e97ebf for instance c042e26f-d7fb-43e8-bfd8-03593ca28f37 on hv-cinder-82869 Sep 09 14:58:46.643944 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:46.644634 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:46.646043 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:46.647451 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:46.648164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:46.648959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:46.656737 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4e7db132-cd88-4d93-83cf-d1295dd408e8 req-696a516b-9ac1-4324-970e-6ad85455e19d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087732 Sep 09 14:58:46.658846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 100/206] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:46.799386 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:46.801665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:46.819692 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:46.820662 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:46.825931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:46.825931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:46.825931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:46.826914 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:46.892747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:46.893433 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:46.894038 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:46.894651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lazy-loading 'fault' on Instance uuid c042e26f-d7fb-43e8-bfd8-03593ca28f37 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 14:58:47.025437 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:47.037839 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f37ab48c-337c-4ad5-a838-f86075a12e60 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1304 microversion: 2.1 time: 0.249272 Sep 09 14:58:47.041987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 101/207] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:46 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1304 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:58:47.126604 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:47.136990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c62387a6-6981-4946-aabc-760751baeab4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.512818 Sep 09 14:58:47.139498 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 107/208] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:46 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:47.548967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:47.550545 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:47.569661 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:47.570407 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:47.571139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:47.580823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:47.582773 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:47.584618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:47.819823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:47.833870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5aea3169-15c4-4af6-a65f-0c6911752592 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1521 microversion: 2.1 time: 0.290599 Sep 09 14:58:47.835274 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 102/209] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:47 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:48.069405 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:48.070949 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:48.097280 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:48.104457 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:48.104941 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:48.105722 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:48.106185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:48.106608 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:48.169910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:48.170500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:48.184355 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:48.194708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:48.195321 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:48.196611 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:48.201542 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:48.202155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:48.217890 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:48.218388 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:48.218824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:48.219276 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lazy-loading 'fault' on Instance uuid c042e26f-d7fb-43e8-bfd8-03593ca28f37 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 14:58:48.502234 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360b149ac8402282733edfc4c67f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3cfdafe89243748fe29bef991b2215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:48.532403 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-babe8414-bdf8-41cf-b5b0-7a5a6c03966a tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 200 len: 1304 microversion: 2.1 time: 0.468284 Sep 09 14:58:48.535402 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 108/210] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:48 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 1304 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:48.813146 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:48.822813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2e97ddf8-460e-446d-bfe1-bdfb97641041 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.659549 Sep 09 14:58:48.845382 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 103/211] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:48 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:48.859635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:48.860402 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:48.877076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:48.878183 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:48.878795 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:48.879937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:48.880978 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:48.881579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:49.208015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:49.232446 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-347964aa-26cf-47a4-9056-10e2aceb7b29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1501 microversion: 2.1 time: 0.378690 Sep 09 14:58:49.233394 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 109/212] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:48 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1501 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:49.255609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:49.256031 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:49.261698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:49.263625 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:49.264192 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:49.264632 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:49.265482 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:49.265938 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:49.268995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:49.561075 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:49.562482 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] [instance: c042e26f-d7fb-43e8-bfd8-03593ca28f37] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:49.571431 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:49.573605 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:49.574228 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:49.575181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:49.577426 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:49.579252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:49.607179 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] HTTP exception thrown: Instance c042e26f-d7fb-43e8-bfd8-03593ca28f37 could not be found. Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Request method failure captured: Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 HTTP/1.1 Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1Rw5sm_xwMZ72l3DceosfhufDzBuyJB8UMBeje2Fcn6DnGaZ4NEXk-WSsB7xHGD-jEFbL1JfhGpg3mjnNIqdFLT2--DJLrMYrv5HQQjPPl7W-C8AdLQ3Rdh07yVcA6VJ-4bV_uVEM41wXX8tYjt9wGnn5CEdBFZ0mW2IGoCeJRadJM Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: bd3cfdafe89243748fe29bef991b2215 Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesActionsTest-1377335741 Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 14:58:49.610074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd3cfdafe89243748fe29bef991b2215"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd3cfdafe89243748fe29bef991b2215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bd3cfdafe89243748fe29bef991b2215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bd3cfdafe89243748fe29bef991b2215", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesActionsTest-1377335741 Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: bd3cfdafe89243748fe29bef991b2215 Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesActionsTest-1377335741 Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesActionsTest-1377335741-project Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: ca360b149ac8402282733edfc4c67f9e Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesActionsTest-1377335741-project Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance c042e26f-d7fb-43e8-bfd8-03593ca28f37 could not be found. Sep 09 14:58:49.611513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': 'c042e26f-d7fb-43e8-bfd8-03593ca28f37'} Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c042e26f-d7fb-43e8-bfd8-03593ca28f37 could not be found. Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:58:49.612359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c042e26f-d7fb-43e8-bfd8-03593ca28f37 could not be found. Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c042e26f-d7fb-43e8-bfd8-03593ca28f37 could not be found. Sep 09 14:58:49.613712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:58:49.615414 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] Returning 404 to user: Instance c042e26f-d7fb-43e8-bfd8-03593ca28f37 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:58:49.615414 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a1494188-7e5d-4261-be39-7818a33f2f51 tempest-VolumesActionsTest-1377335741 tempest-VolumesActionsTest-1377335741-project] 10.222.0.15 "GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37" status: 404 len: 111 microversion: 2.1 time: 0.059527 Sep 09 14:58:49.622582 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 110/213] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:49 2022] GET /compute/v2.1/servers/c042e26f-d7fb-43e8-bfd8-03593ca28f37 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 14:58:49.663552 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:49.674087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab806935-4812-490c-a99f-bf4d5595a792 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1516 microversion: 2.1 time: 0.423188 Sep 09 14:58:49.675580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 104/214] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:49 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1516 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:49.856894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:49.858335 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:49.875424 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:49.876426 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:49.877046 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:49.883444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:49.884162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:49.886048 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:50.138403 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-0e7608df-9a0d-4d0d-869b-9d61757ead82 req-99e958c6-bdff-46f7-86df-afcdbee1f6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762529ff-2c14-4d96-85cb-3908b1f9e26b", "name": "network-vif-plugged", "status": "completed", "tag": "112e83fe-adcc-47b0-8085-50326186abe9"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:50.169341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0e7608df-9a0d-4d0d-869b-9d61757ead82 req-99e958c6-bdff-46f7-86df-afcdbee1f6f3 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:50.170466 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0e7608df-9a0d-4d0d-869b-9d61757ead82 req-99e958c6-bdff-46f7-86df-afcdbee1f6f3 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:50.172750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0e7608df-9a0d-4d0d-869b-9d61757ead82 req-99e958c6-bdff-46f7-86df-afcdbee1f6f3 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:50.200268 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-0e7608df-9a0d-4d0d-869b-9d61757ead82 req-99e958c6-bdff-46f7-86df-afcdbee1f6f3 service nova] Creating event network-vif-plugged:112e83fe-adcc-47b0-8085-50326186abe9 for instance 762529ff-2c14-4d96-85cb-3908b1f9e26b on hv-cinder-82869 Sep 09 14:58:50.223009 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-0e7608df-9a0d-4d0d-869b-9d61757ead82 req-99e958c6-bdff-46f7-86df-afcdbee1f6f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092693 Sep 09 14:58:50.224383 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 105/215] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:50.396770 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:50.410668 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-06c19829-e502-453c-a282-c1e363c77776 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.558848 Sep 09 14:58:50.411654 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 111/216] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:49 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:50.988366 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb5dbdb4-de5a-41d6-9afd-db10581bdf70 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Action: 'create', calling method: .version_select at 0x7f8ad2a1e700>, body: {"keypair": {"name": "tempest-TestShelveInstance-594703633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0vGGRuoEEfYqkkUYuQkL1ojjPHo1Bf1e/dbp3bh53dhYuhsK37Un07u3lnoeIf2jd3PaavG8XL4Fx1XlFqfPEZ34//dW743K9/Ruq+L8WxVnlpW4IHqZj4jbfDo/Gomg=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:51.018387 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-bb5dbdb4-de5a-41d6-9afd-db10581bdf70 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Getting quotas for project 3f711f25c212427db970f02391c79d1c. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:58:51.025246 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-bb5dbdb4-de5a-41d6-9afd-db10581bdf70 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Getting quotas for user 0eccc82843084cb392b1f15ad2ac9268 and project 3f711f25c212427db970f02391c79d1c. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:58:51.084750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb5dbdb4-de5a-41d6-9afd-db10581bdf70 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.383642 Sep 09 14:58:51.085486 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 106/217] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 14:58:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:51.438530 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:51.439237 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:51.450850 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:51.451707 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:51.451800 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:51.457692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:51.458295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:51.461700 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:51.702007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:51.716233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-22373d10-1dda-4025-ba10-3e33e302606d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.283385 Sep 09 14:58:51.717461 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 112/218] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:51 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:51.881865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:51.886131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:51.894514 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:51.895016 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:51.895458 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:51.896163 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:51.896823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:51.897511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:51.923022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lazy-loading 'flavor' on Instance uuid fbddff0a-cdd3-4537-821e-decd3714e96d {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 14:58:52.036813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62bde3b3-5170-4299-9e57-895a123da534 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d/action" status: 200 len: 32 microversion: 2.1 time: 0.146592 Sep 09 14:58:52.044698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 107/219] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 14:58:51 2022] POST /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 14:58:52.054852 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:52.055758 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:52.071878 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:52.072910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:52.073631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:52.075200 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:52.075849 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:52.076460 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:52.272341 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:52.283869 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-76657c1d-087e-4d36-bb7e-eecde4dd8094 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.233287 Sep 09 14:58:52.286650 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 113/220] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:52 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:52.744019 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:52.745772 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:52.752866 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:52.753711 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:52.754349 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:52.755322 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:52.755977 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:52.756894 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:52.922394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:52.932623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1835cf18-d12a-40cc-8723-fe81b9e1382c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.193804 Sep 09 14:58:52.933652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 108/221] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:52 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:53.313365 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:53.313985 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:53.320740 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:53.323135 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:53.323839 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:53.324821 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:53.325386 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:53.326032 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:53.464920 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:53.467293 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:53.475338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f5c7e9e2-28ad-4ae4-80a1-ae329365ea5a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.165822 Sep 09 14:58:53.475914 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 114/222] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:53 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:53.958084 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:53.958690 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:53.964649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:53.965120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:53.965643 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:53.966271 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:53.966717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:53.967134 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:54.102660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:54.110891 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97c42614-ac08-4dc8-a6fd-7c8d253a48c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.156604 Sep 09 14:58:54.111457 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 109/223] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:53 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:54.497950 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:54.498501 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:54.504894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:54.505421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:54.505862 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:54.506561 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:54.507019 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:54.507447 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:54.638201 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:54.646471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b749dd47-5d92-4e9a-b82d-cc1cb98e3db0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.152410 Sep 09 14:58:54.647052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 115/224] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:54 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:55.134128 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:55.135344 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:55.141398 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:55.141879 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:55.142313 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:55.142993 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:55.143440 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:55.143859 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:55.277551 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:55.287606 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25db1aa4-60db-43c0-9a05-840aa47bcf9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1362 microversion: 2.1 time: 0.157475 Sep 09 14:58:55.288282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 110/225] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:55 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:55.670148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:55.670843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:55.677487 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:55.677975 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:55.678436 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:55.679116 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:55.679576 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:55.680007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:55.877933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:55.885691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-844aba4c-ecde-4a2d-90d0-83dd170c370c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.219882 Sep 09 14:58:55.886389 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 116/226] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:55 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:56.314705 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:56.315338 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:56.321704 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:56.322806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:56.323106 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:56.323790 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:56.324237 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:56.324651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:56.454489 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:56.462683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-514e9128-6fbb-4b6b-b4fd-92af63d2ee0b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1548 microversion: 2.1 time: 0.151755 Sep 09 14:58:56.463892 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 111/227] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:56 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:56.487912 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a62b5664-3e71-41fc-b1ec-62ef898cbee7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:56.488381 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a62b5664-3e71-41fc-b1ec-62ef898cbee7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:56.494754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62b5664-3e71-41fc-b1ec-62ef898cbee7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:56.495243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62b5664-3e71-41fc-b1ec-62ef898cbee7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:56.495703 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62b5664-3e71-41fc-b1ec-62ef898cbee7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:56.496395 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62b5664-3e71-41fc-b1ec-62ef898cbee7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:56.496847 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62b5664-3e71-41fc-b1ec-62ef898cbee7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:56.497301 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62b5664-3e71-41fc-b1ec-62ef898cbee7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:56.578826 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a62b5664-3e71-41fc-b1ec-62ef898cbee7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094816 Sep 09 14:58:56.579431 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 117/228] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 14:58:56 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:56.910683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:56.911312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:56.919507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:56.919507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:56.919507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:56.919901 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:56.920328 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:56.920745 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:57.143794 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:57.160931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17188785-351b-4967-a749-4e5892a225c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.253787 Sep 09 14:58:57.162017 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 112/229] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:56 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:57.846976 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-6bf2e0fb-db5c-45a8-aec6-c002ea0a4cdb req-6c5f6e9f-d374-4e92-8945-80e26c9a7563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762529ff-2c14-4d96-85cb-3908b1f9e26b", "tag": "112e83fe-adcc-47b0-8085-50326186abe9"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:58:57.858700 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-6bf2e0fb-db5c-45a8-aec6-c002ea0a4cdb req-6c5f6e9f-d374-4e92-8945-80e26c9a7563 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:57.859945 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-6bf2e0fb-db5c-45a8-aec6-c002ea0a4cdb req-6c5f6e9f-d374-4e92-8945-80e26c9a7563 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:57.859945 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-6bf2e0fb-db5c-45a8-aec6-c002ea0a4cdb req-6c5f6e9f-d374-4e92-8945-80e26c9a7563 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:57.874513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-6bf2e0fb-db5c-45a8-aec6-c002ea0a4cdb req-6c5f6e9f-d374-4e92-8945-80e26c9a7563 service nova] Creating event network-changed:112e83fe-adcc-47b0-8085-50326186abe9 for instance 762529ff-2c14-4d96-85cb-3908b1f9e26b on hv-cinder-82869 Sep 09 14:58:57.879763 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-6bf2e0fb-db5c-45a8-aec6-c002ea0a4cdb req-6c5f6e9f-d374-4e92-8945-80e26c9a7563 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036385 Sep 09 14:58:57.880588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 118/230] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:58:58.187548 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:58.188366 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:58.198806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:58.199310 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:58.199748 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:58.200467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:58.200924 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:58.201397 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:58.459928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:58.467770 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2fd8a113-40e7-4a1b-8031-0e8b5d7d0754 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.286399 Sep 09 14:58:58.502048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 113/231] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:58 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:58:59.496649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:58:59.497393 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:58:59.503603 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:59.504090 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:59.504595 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:59.505536 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:58:59.506185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:58:59.506737 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:58:59.666522 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:58:59.675114 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f347db0-1de3-4608-9514-e6856a8b461a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.183923 Sep 09 14:58:59.675879 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 119/232] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:58:59 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:00.050181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28b499a8-a99e-4770-8962-5853da8ad918 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:00.050703 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28b499a8-a99e-4770-8962-5853da8ad918 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:00.056647 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b499a8-a99e-4770-8962-5853da8ad918 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:00.057711 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b499a8-a99e-4770-8962-5853da8ad918 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:00.058147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b499a8-a99e-4770-8962-5853da8ad918 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:00.058854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b499a8-a99e-4770-8962-5853da8ad918 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:00.059325 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b499a8-a99e-4770-8962-5853da8ad918 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:00.059748 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b499a8-a99e-4770-8962-5853da8ad918 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:00.063608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:00.084710 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28b499a8-a99e-4770-8962-5853da8ad918 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/ips" status: 200 len: 149 microversion: 2.1 time: 0.038455 Sep 09 14:59:00.085300 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 114/233] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 14:59:00 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:00.699695 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:00.700309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:00.708352 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:00.709095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:00.709823 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:00.710895 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:00.711604 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:00.712272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:00.856910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:00.864522 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2fe81914-b8f5-4178-8971-36a5b8e6eaf5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.168878 Sep 09 14:59:00.865081 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 120/234] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:00 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:01.476744 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c467e52-e803-4725-9e7d-dd486c0d8fd6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85e3cae2-6606-4f51-9ad0-daf84ff93ef6"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:01.479205 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c467e52-e803-4725-9e7d-dd486c0d8fd6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:01.481935 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:01.487367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c467e52-e803-4725-9e7d-dd486c0d8fd6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:01.487848 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c467e52-e803-4725-9e7d-dd486c0d8fd6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:01.488281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c467e52-e803-4725-9e7d-dd486c0d8fd6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:01.488994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c467e52-e803-4725-9e7d-dd486c0d8fd6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:01.489479 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c467e52-e803-4725-9e7d-dd486c0d8fd6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:01.489903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c467e52-e803-4725-9e7d-dd486c0d8fd6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:01.642012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-11412352-45b7-411a-bccf-9c51c7b24074 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:01.642649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-11412352-45b7-411a-bccf-9c51c7b24074 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:01.648895 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11412352-45b7-411a-bccf-9c51c7b24074 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:01.649501 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11412352-45b7-411a-bccf-9c51c7b24074 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:01.650023 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11412352-45b7-411a-bccf-9c51c7b24074 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:01.650778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11412352-45b7-411a-bccf-9c51c7b24074 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:01.651893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11412352-45b7-411a-bccf-9c51c7b24074 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:01.652273 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11412352-45b7-411a-bccf-9c51c7b24074 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:01.677044 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-11412352-45b7-411a-bccf-9c51c7b24074 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/ips" status: 200 len: 153 microversion: 2.20 time: 0.038957 Sep 09 14:59:01.684079 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 121/235] 10.222.0.15 () {60 vars in 1289 bytes} [Fri Sep 9 14:59:01 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 14:59:01.777184 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c467e52-e803-4725-9e7d-dd486c0d8fd6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303891 Sep 09 14:59:01.783803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 115/236] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 14:59:01 2022] POST /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:01.888799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:01.889635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:01.900728 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:01.901410 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:01.902667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:01.903621 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:01.904222 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:01.904801 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:02.069601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:02.078061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4df43b88-c757-4bfe-801f-f341c4afa9fb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.194124 Sep 09 14:59:02.078669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 122/237] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:01 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:03.101372 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:03.102082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:03.109484 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:03.109969 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:03.110406 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:03.111104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:03.111560 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:03.111991 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:03.245932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:03.254450 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec9d224e-9135-4f6c-81c5-089699122468 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.157640 Sep 09 14:59:03.255042 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 116/238] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:03 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:04.278960 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:04.279566 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:04.282204 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=66 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:04.288151 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:04.288665 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:04.289122 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:04.289903 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:04.290478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:04.290930 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:04.367926 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:04.368964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:04.377965 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:04.379196 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:04.380004 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:04.381339 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:04.381817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:04.382261 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:04.407684 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lazy-loading 'flavor' on Instance uuid af9e901f-c6b3-4840-ae33-2953c8e39eee {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 14:59:04.424966 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:04.433215 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0c5cf5a9-58cd-409c-88e9-be0dfc4cba8d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.158884 Sep 09 14:59:04.433792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 123/239] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:04 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:05.456139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:05.457116 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:05.463763 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:05.464245 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:05.464684 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:05.465423 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:05.465879 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:05.466299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:05.601460 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:05.609834 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0a7f6311-b8df-4b5a-9a4c-879403011a11 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.157853 Sep 09 14:59:05.610436 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 124/240] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:05 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:06.631804 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:06.632491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:06.638832 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:06.639313 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:06.639747 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:06.640431 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:06.640884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:06.641335 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:06.776172 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:06.784824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ba656e7-07ca-4761-94db-84ca464b20c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.156900 Sep 09 14:59:06.785411 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 125/241] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:06 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:07.807721 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:07.809044 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:07.815253 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:07.815731 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:07.816164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:07.816841 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:07.817378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:07.817799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:07.947360 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:07.955331 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a48d01c9-ecbe-4f75-ab24-3732e418e5cf tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.151664 Sep 09 14:59:07.955912 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 126/242] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:07 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:08.978576 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:08.979203 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:08.986085 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:08.986573 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:08.987016 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:08.987712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:08.988173 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:08.988602 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:09.121340 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:09.129477 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88f85c23-e92e-45ff-880b-dce06da544d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.154707 Sep 09 14:59:09.130038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 127/243] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:08 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:09.346888 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-53502cac-dfd8-4fa8-8573-a59546497fd3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: .version_select at 0x7f8ad3e603a0>, body: {"keypair": {"name": "tempest-keypair-280715033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7XE0lh/9Pyxdd1EIUs0OU4KHOWdSXPaAYbz+djg5hKoafbdBxwKbjVZv6Ze9NqUUSWnn+fIJB16r7364QnAv0GIrhKuVbJkArUotmTxE/6G9rnOp7y12Ch0zk64//OVg=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:09.366202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-53502cac-dfd8-4fa8-8573-a59546497fd3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for project 063bdf7448ee45939287687b0e65dd97. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:59:09.370119 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-53502cac-dfd8-4fa8-8573-a59546497fd3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for user 770105b06e084179a819a54d28b70cdf and project 063bdf7448ee45939287687b0e65dd97. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:59:09.394081 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-53502cac-dfd8-4fa8-8573-a59546497fd3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050434 Sep 09 14:59:09.394689 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 128/244] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 14:59:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 14:59:10.157789 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:10.159902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:10.167769 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:10.168392 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:10.169062 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:10.170162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:10.170770 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:10.172089 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:10.379171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:10.391356 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82134338-2b01-45c3-addd-c2da7927e6a1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.241933 Sep 09 14:59:10.393139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 129/245] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:10 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:10.900762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-579250026", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ced1175-a542-4682-b032-b597d6969844"}], "security_groups": [{"name": "tempest-securitygroup--327801142"}], "key_name": "tempest-keypair-280715033", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:12.245993 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42fc8dc7-549b-4f30-bd8c-ce3f0caace9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/action" status: 202 len: 0 microversion: 2.20 time: 7.883035 Sep 09 14:59:12.251254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 117/246] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Sep 9 14:59:04 2022] POST /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/action => generated 0 bytes in 7889 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 14:59:12.258725 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:12.259426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:12.268291 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:12.269155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:12.270147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:12.270877 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:12.271377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:12.271804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:12.309361 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] validate_networks() for [('2ced1175-a542-4682-b032-b597d6969844', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:59:12.634511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:12.644523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5f95cb0-9a8b-4d2e-97ab-b9500528d72f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.391513 Sep 09 14:59:12.660721 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 118/247] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:12 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:12.665999 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:12.666861 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:12.673709 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:12.674453 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:12.675117 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:12.676033 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:12.676679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:12.677408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:12.835923 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:59:12.836297 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:59:12.836970 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:59:12.837618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:59:12.838255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:59:12.852152 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:12.855030 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:12.855749 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:12.857679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:12.858525 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:12.859243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:12.875235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:12.883496 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for project 063bdf7448ee45939287687b0e65dd97. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:59:12.883880 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:12.885344 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:12.886845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-786599f3-a5a7-47d3-8e75-dd45d0c892f9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.224635 Sep 09 14:59:12.888253 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 119/248] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:12 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:12.889823 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for user 770105b06e084179a819a54d28b70cdf and project 063bdf7448ee45939287687b0e65dd97. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:59:12.902690 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:59:12.905845 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:59:12.960206 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-18ebafc9-c0a8-4b38-bf67-277d2f7811ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.063572 Sep 09 14:59:12.969309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 130/249] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:59:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 2065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 14:59:12.983303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9bd0f87d-72f0-457c-9af0-2a9804e9ca1e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:12.984928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9bd0f87d-72f0-457c-9af0-2a9804e9ca1e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:13.077537 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9bd0f87d-72f0-457c-9af0-2a9804e9ca1e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:13.085887 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9bd0f87d-72f0-457c-9af0-2a9804e9ca1e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1240 microversion: 2.1 time: 0.109433 Sep 09 14:59:13.086701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 120/250] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:12 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:13.668802 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:13.669568 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:13.687961 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:13.688698 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:13.689510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:13.690790 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:13.691484 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:13.692130 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:13.835230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:13.845952 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-63e08ced-a995-4df2-904f-f6e3267e2a58 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.181654 Sep 09 14:59:13.846676 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 131/251] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:13 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:13.915840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:13.916446 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:13.922963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:13.923444 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:13.923877 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:13.924561 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:13.925014 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:13.925466 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:14.065592 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:14.073618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:14.075108 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:14.076815 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5868391c-4a5c-4bad-8558-29628fe46759 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.164880 Sep 09 14:59:14.077402 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 121/252] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:13 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:14.109030 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:14.109702 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:14.115666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:14.116148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:14.116636 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:14.117353 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:14.117814 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:14.118238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:14.193234 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:14.201660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0f1a7211-5d84-4e4f-9632-b2915fcd68c2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1292 microversion: 2.1 time: 0.096525 Sep 09 14:59:14.206469 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 132/253] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:14 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:14.868575 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:14.869246 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:14.877742 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:14.878446 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:14.879071 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:14.879954 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:14.880570 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:14.881161 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:15.103886 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:15.105495 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:15.120006 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:15.120507 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:15.120975 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:15.121758 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:15.122975 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:15.123550 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:15.299393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:15.310006 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c31b4fd0-b932-4562-9ed4-817f83aac6d2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.444966 Sep 09 14:59:15.313821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 122/254] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:14 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:15.323875 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:15.325689 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:15.332785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:15.333687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:15.334233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:15.335266 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:15.335824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:15.336634 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:15.352391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:15.363719 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:15.365364 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:15.366612 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8ab25cfa-99f8-40e8-a347-0aef8a4d0388 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.269197 Sep 09 14:59:15.367497 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 133/255] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:15 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:15.404016 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:15.413352 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9294895e-4b51-4720-9cb2-ce202d24bab9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1298 microversion: 2.1 time: 0.097164 Sep 09 14:59:15.414132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 123/256] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:15 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:16.339446 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:16.342241 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:16.360328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:16.361543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:16.362907 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:16.364583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:16.365699 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:16.367561 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:16.393870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:16.396300 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:16.397025 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:16.408457 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:16.409254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:16.409912 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:16.410879 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:16.411547 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:16.412236 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:16.820778 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:16.831544 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:16.833485 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:16.839890 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-817edaf5-4cf0-46d8-a06b-ea392e313f90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.505172 Sep 09 14:59:16.842508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:16.843917 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68d9bb8a-d3d8-4a07-b77b-17f39753fd79 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.451556 Sep 09 14:59:16.846002 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 134/257] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:16 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:16.862133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:16.863411 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:16.876231 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 124/258] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:16 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:16.876959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:16.877983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:16.880990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:16.882277 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:16.884125 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:16.885406 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:17.163961 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:17.174409 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-af411d48-752e-44f3-829b-de158aa27129 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1365 microversion: 2.1 time: 0.326946 Sep 09 14:59:17.175323 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 135/259] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:16 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:17.466015 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c89557b6-547d-4e05-a1f4-e0b36db99945 req-fb957652-95d9-48f7-92f1-129bc8dfb11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d7f23b-6ebe-4a3a-9c5d-47a52df51a92", "tag": "a6328979-e994-4108-87dc-e3b7e7729e74"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:17.501248 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c89557b6-547d-4e05-a1f4-e0b36db99945 req-fb957652-95d9-48f7-92f1-129bc8dfb11f service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:17.506585 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c89557b6-547d-4e05-a1f4-e0b36db99945 req-fb957652-95d9-48f7-92f1-129bc8dfb11f service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:17.507373 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c89557b6-547d-4e05-a1f4-e0b36db99945 req-fb957652-95d9-48f7-92f1-129bc8dfb11f service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:17.524869 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c89557b6-547d-4e05-a1f4-e0b36db99945 req-fb957652-95d9-48f7-92f1-129bc8dfb11f service nova] Creating event network-changed:a6328979-e994-4108-87dc-e3b7e7729e74 for instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 on hv-cinder-82869 Sep 09 14:59:17.531129 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c89557b6-547d-4e05-a1f4-e0b36db99945 req-fb957652-95d9-48f7-92f1-129bc8dfb11f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073324 Sep 09 14:59:17.532289 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 125/260] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:17.868594 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:17.869962 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:17.879785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:17.880526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:17.881134 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:17.882022 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:17.882647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:17.883107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:17.885268 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:17.886274 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:17.894898 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:17.895453 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:17.896030 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:17.896793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:17.897485 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:17.897998 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:18.240002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:18.250758 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:18.252850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:18.254150 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f49eded6-da54-4866-88c0-4eb583da9039 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.374315 Sep 09 14:59:18.254717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 126/261] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:17 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:18.255958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:18.259418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:18.260080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:18.266643 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:18.267282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:18.267733 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:18.268421 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:18.268875 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:18.269348 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:18.269999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8557e39c-9552-413c-b52d-0f48e6a35da4 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.405820 Sep 09 14:59:18.272092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 136/262] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:17 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:18.436171 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:18.443761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9546777f-ccf8-4007-b254-7d2632a32760 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1365 microversion: 2.1 time: 0.188082 Sep 09 14:59:18.444619 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 127/263] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:18 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:19.281420 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:19.282831 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:19.290290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:19.291083 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:19.291537 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:19.292461 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:19.292962 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:19.293425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:19.294720 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:19.296020 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:19.298827 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:19.305177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:19.305871 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:19.306375 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:19.307143 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:19.307832 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:19.308325 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:19.529027 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:19.539096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:19.540793 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:19.541866 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:19.542455 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c7120f2-0109-42d2-ac75-a1da47ae7cb5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.266275 Sep 09 14:59:19.543209 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 137/264] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:19 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:19.548444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:19.549337 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:19.550022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cacd120-9fea-4e98-9492-8bdb8ba10968 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.259936 Sep 09 14:59:19.557339 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:19.558181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:19.558842 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:19.559782 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:19.560435 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:19.561177 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:19.562975 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 128/265] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:19 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:19.725179 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:19.733844 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-69732337-f75a-4f85-80b2-d7913967aceb tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1365 microversion: 2.1 time: 0.189078 Sep 09 14:59:19.745219 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 138/266] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:19 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:20.580110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:20.580734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:20.587215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:20.587631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:20.587812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:20.588255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:20.588479 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:20.589093 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:20.589620 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:20.590169 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:20.596844 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:20.597377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:20.597825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:20.598532 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:20.598987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:20.599519 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:20.627739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:20.846057 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:20.865154 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:20.866639 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:20.870845 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:20.875141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76372af9-05df-41c4-812c-394a6e1a04bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.307221 Sep 09 14:59:20.876133 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 129/267] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:20 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:20.880731 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:20.881375 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:20.890583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-10827c50-881e-484a-841f-8e1283046c3e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.317350 Sep 09 14:59:20.895341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:20.895846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:20.896288 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:20.897025 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:20.897485 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:20.899294 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:20.903889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 139/268] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:20 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:20.908859 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-991657328", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-594703633", "security_groups": [{"name": "tempest-secgroup-smoke-2014036111"}], "networks": [{"uuid": "8d2d50ee-a393-4bca-920f-08b3f70f628d"}], "block_device_mapping_v2": [{"uuid": "8a6225ac-6300-4773-8a22-7f1ef6d14316", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:21.107644 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] validate_networks() for [('8d2d50ee-a393-4bca-920f-08b3f70f628d', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:59:21.279341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:21.295522 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-289cd0a2-1e59-4eb8-a0dd-f1798debd410 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1365 microversion: 2.1 time: 0.416245 Sep 09 14:59:21.295649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 130/269] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:20 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:21.658840 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:59:21.660301 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:59:21.661089 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:59:21.661857 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:59:21.662438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:59:21.672958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:21.673760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:21.674206 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:21.675107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:21.675576 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:21.676199 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:21.702362 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Getting quotas for project 3f711f25c212427db970f02391c79d1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:59:21.707052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Getting quotas for user 0eccc82843084cb392b1f15ad2ac9268 and project 3f711f25c212427db970f02391c79d1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:59:21.772324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:59:21.774691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a6225ac-6300-4773-8a22-7f1ef6d14316',volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:59:21.903104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:21.904447 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:21.914653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:21.915242 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:21.915831 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:21.916994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:21.917688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:21.918125 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:21.946248 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-403c0ef5-88b6-4547-9adf-a57836f6ccad tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.041137 Sep 09 14:59:21.947529 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 140/270] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:59:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 14:59:21.952276 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:21.953144 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:21.964438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:21.965953 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:21.966599 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:21.968117 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:21.968751 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:21.969399 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:22.144363 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:22.161905 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:22.163973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:22.165768 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-227c743b-55e1-460d-ab3b-6a30e87c0676 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.267136 Sep 09 14:59:22.166958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 131/271] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:21 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:22.172687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a1929b1-bb27-4536-a8ff-7fc81d0db132 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:22.173313 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a1929b1-bb27-4536-a8ff-7fc81d0db132 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:22.267065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a1929b1-bb27-4536-a8ff-7fc81d0db132 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:22.275952 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a1929b1-bb27-4536-a8ff-7fc81d0db132 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1087 microversion: 2.1 time: 0.107751 Sep 09 14:59:22.277817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 132/272] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:22 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1087 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:22.283925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:22.302695 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b04831f2-f07e-46e6-b4da-e59d7d7779f3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.353583 Sep 09 14:59:22.304109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 141/273] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:21 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:22.328803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:22.330739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:22.345123 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:22.348122 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:22.348797 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:22.349999 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:22.350805 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:22.351337 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:22.550287 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:22.560976 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2830c0a3-22f0-41d7-82f0-cfd06441114c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1365 microversion: 2.1 time: 0.241473 Sep 09 14:59:22.561930 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 133/274] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:22 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:23.199883 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:23.201142 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:23.210315 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:23.211004 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:23.211607 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:23.212469 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:23.213091 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:23.213881 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:23.303500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:23.304345 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:23.315679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:23.316704 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:23.317407 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:23.318509 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:23.319189 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:23.324106 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:23.391040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:23.405744 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:23.407236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:23.414760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-59840ccd-a210-459a-9952-50bee1fd3556 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.218548 Sep 09 14:59:23.415791 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 142/275] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:23 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:23.437689 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:23.448084 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c0add52a-e1e2-4fcc-8f9c-625f3e3d1860 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1137 microversion: 2.1 time: 0.148361 Sep 09 14:59:23.456597 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 134/276] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:23 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1137 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:23.456792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:23.456792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:23.465386 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:23.466440 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:23.467463 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:23.468268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:23.468674 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:23.469131 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:23.584359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:23.585147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:23.592228 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:23.592719 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:23.593977 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:23.595099 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:23.595913 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:23.596537 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:23.616115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:23.624828 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9cc2c48a-ce5c-4649-82e5-8472bc503249 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.193579 Sep 09 14:59:23.625932 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 143/277] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:23 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:23.749929 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:23.759148 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de3d4dd5-8abb-4c88-afa6-f1734fc10aa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1365 microversion: 2.1 time: 0.178850 Sep 09 14:59:23.773580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 135/278] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:23 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:24.450512 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:24.451759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:24.460309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:24.460794 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:24.461238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:24.461939 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:24.462391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:24.462816 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:24.475293 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:24.477055 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:24.486018 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:24.487238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:24.487887 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:24.488926 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:24.489623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:24.490284 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:24.561744 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:24.572102 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bc077f6-3a81-44fc-95e2-1213b1de35f9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1137 microversion: 2.1 time: 0.100050 Sep 09 14:59:24.572525 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 136/279] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:24 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1137 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:24.664320 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:24.665039 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:24.672641 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:24.673266 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:24.673776 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:24.678234 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:24.678734 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:24.679180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:24.692325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:24.703651 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:24.705483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:24.707026 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c127f2fa-8283-4603-9d3d-8f742641e487 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.263120 Sep 09 14:59:24.708205 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 144/280] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:24 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:24.785417 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:24.786215 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:24.794790 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:24.795291 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:24.795760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:24.796821 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:24.797320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:24.797754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:24.941547 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:24.958474 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a384de99-aa48-4445-8f10-2e0c273b84eb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.292483 Sep 09 14:59:24.959381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 137/281] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:24 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:25.017693 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:25.026872 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-614b4499-623f-45cf-b9e0-d927d803512b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1365 microversion: 2.1 time: 0.246274 Sep 09 14:59:25.042626 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 145/282] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:24 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:25.385870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-47e0d51f-a9c2-4b1b-b386-19bd9a99b552 req-d4ee2c67-ed70-42a3-a7af-c84883475f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d7f23b-6ebe-4a3a-9c5d-47a52df51a92", "name": "network-vif-plugged", "status": "completed", "tag": "a6328979-e994-4108-87dc-e3b7e7729e74"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:25.398317 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-47e0d51f-a9c2-4b1b-b386-19bd9a99b552 req-d4ee2c67-ed70-42a3-a7af-c84883475f95 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:25.398806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-47e0d51f-a9c2-4b1b-b386-19bd9a99b552 req-d4ee2c67-ed70-42a3-a7af-c84883475f95 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:25.399259 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-47e0d51f-a9c2-4b1b-b386-19bd9a99b552 req-d4ee2c67-ed70-42a3-a7af-c84883475f95 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:25.425352 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-47e0d51f-a9c2-4b1b-b386-19bd9a99b552 req-d4ee2c67-ed70-42a3-a7af-c84883475f95 service nova] Creating event network-vif-plugged:a6328979-e994-4108-87dc-e3b7e7729e74 for instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 on hv-cinder-82869 Sep 09 14:59:25.437304 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-47e0d51f-a9c2-4b1b-b386-19bd9a99b552 req-d4ee2c67-ed70-42a3-a7af-c84883475f95 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055627 Sep 09 14:59:25.439951 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 138/283] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:25.597092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:25.597858 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:25.605227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:25.605958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:25.606496 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:25.607354 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:25.608610 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:25.609402 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:25.736459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:25.737267 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:25.748890 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:25.750530 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:25.750530 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:25.754055 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:25.754735 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:25.755336 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:25.773120 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:25.787249 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-55df7e03-f57d-41b5-8f74-17970ccdd50f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1185 microversion: 2.1 time: 0.194349 Sep 09 14:59:25.790561 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 146/284] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:25 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:25.982639 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:25.983512 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:25.994657 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:26.005096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:26.005707 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:26.006070 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:26.006812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:26.007296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:26.007727 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:26.015325 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:26.016989 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:26.018257 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a663e1a-aa6c-4714-8289-9a0f18016bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.287506 Sep 09 14:59:26.033530 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 139/285] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:25 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:26.051972 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:26.052612 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:26.059081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:26.060770 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:26.062220 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:26.063112 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:26.063795 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:26.064595 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:26.326787 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:26.335611 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5c41b169-afa3-46ec-9f54-d34fd23c232d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.356976 Sep 09 14:59:26.336541 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 147/286] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:25 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:26.405951 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:26.415873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f9a3335-35ea-4b89-a773-b96b9dd247b7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1365 microversion: 2.1 time: 0.368292 Sep 09 14:59:26.417173 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 140/287] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:26 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:26.810944 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:26.810944 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:26.818277 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:26.818947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:26.819500 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:26.820314 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:26.821129 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:26.821689 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:26.895374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:26.904756 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-21bc6d1b-aa36-46d5-bd0c-afd129971aa7 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1203 microversion: 2.1 time: 0.098763 Sep 09 14:59:26.917937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 148/288] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:26 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1203 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:27.044534 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:27.045269 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:27.054011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:27.054582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:27.055128 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:27.056360 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:27.057249 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:27.057574 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:27.335731 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:27.345346 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:27.346691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:27.348072 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5970cdd1-ecc2-497f-8b82-9a7966ee1d91 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.308032 Sep 09 14:59:27.349027 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 141/289] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:27 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:27.364911 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:27.365785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:27.375176 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:27.377819 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:27.380143 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:27.381174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:27.381836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:27.384756 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:27.448492 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:27.454094 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:27.461533 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:27.462215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:27.462816 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:27.464086 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:27.464341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:27.464946 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:27.688955 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:27.697359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-62d4be46-f85b-436d-aa1c-ed6edf3b05b5 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.338582 Sep 09 14:59:27.715299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 149/290] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:27 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:27.773329 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:27.789708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80a364c9-daca-4062-a66d-ba172a0c705d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1365 microversion: 2.1 time: 0.352062 Sep 09 14:59:27.794469 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 142/291] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:27 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:27.930899 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:27.931524 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:27.947373 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:27.947887 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:27.949666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:27.952302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:27.952975 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:27.955488 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:28.379874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:28.381449 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:28.399251 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:28.399675 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:28.399806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:28.400250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:28.401407 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:28.409545 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:28.411115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-174f5dd1-1c3e-48e4-afe8-1040f822bc15 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1271 microversion: 2.1 time: 0.484732 Sep 09 14:59:28.411863 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:28.412031 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 150/292] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:27 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1271 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:28.685912 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:28.701327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:28.703580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:28.705157 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ebdf9487-0d89-4928-aa05-cd4015c4d09d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.330774 Sep 09 14:59:28.726608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 143/293] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:28 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:28.726981 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:28.727793 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:28.740320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:28.741063 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:28.741702 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:28.742573 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:28.743191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:28.743789 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:28.813775 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:28.814446 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:28.823017 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:28.823863 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:28.824492 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:28.826102 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:28.826854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:28.827797 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:29.090103 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:29.092932 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:29.100765 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2b58541a-49ef-4ed6-a4d3-37347fa34177 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.377810 Sep 09 14:59:29.117300 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 151/294] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:28 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:29.135460 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-da1906e9-f0c0-44a1-a3b4-38a5475b8d85 req-59309930-0046-49d5-84e3-f018cbfb67e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de85eb6c-027b-4f9b-95e0-654217d6514e", "tag": "e3d39b24-1d9b-4caf-a284-b75b3c187cde"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:29.141543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:29.147884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-da1906e9-f0c0-44a1-a3b4-38a5475b8d85 req-59309930-0046-49d5-84e3-f018cbfb67e5 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:29.148521 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-da1906e9-f0c0-44a1-a3b4-38a5475b8d85 req-59309930-0046-49d5-84e3-f018cbfb67e5 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:29.149229 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-da1906e9-f0c0-44a1-a3b4-38a5475b8d85 req-59309930-0046-49d5-84e3-f018cbfb67e5 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:29.163083 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:29.163297 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-da1906e9-f0c0-44a1-a3b4-38a5475b8d85 req-59309930-0046-49d5-84e3-f018cbfb67e5 service nova] Creating event network-changed:e3d39b24-1d9b-4caf-a284-b75b3c187cde for instance de85eb6c-027b-4f9b-95e0-654217d6514e on hv-cinder-82869 Sep 09 14:59:29.173250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73ffb50e-bc21-4433-8a67-e27b57226680 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1555 microversion: 2.1 time: 0.363203 Sep 09 14:59:29.181283 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 144/295] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:28 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1555 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:29.181508 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-da1906e9-f0c0-44a1-a3b4-38a5475b8d85 req-59309930-0046-49d5-84e3-f018cbfb67e5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047955 Sep 09 14:59:29.181508 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 152/296] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 14:59:29.197283 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d256e2e-fc60-4377-af9e-9d3bb1747ead tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:29.197842 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d256e2e-fc60-4377-af9e-9d3bb1747ead tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:29.206650 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d256e2e-fc60-4377-af9e-9d3bb1747ead tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:29.207199 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d256e2e-fc60-4377-af9e-9d3bb1747ead tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:29.207568 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d256e2e-fc60-4377-af9e-9d3bb1747ead tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:29.208297 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d256e2e-fc60-4377-af9e-9d3bb1747ead tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:29.208731 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d256e2e-fc60-4377-af9e-9d3bb1747ead tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:29.209146 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d256e2e-fc60-4377-af9e-9d3bb1747ead tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:29.315855 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d256e2e-fc60-4377-af9e-9d3bb1747ead tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122571 Sep 09 14:59:29.318408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 145/297] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 14:59:29 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:29.436009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:29.436787 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:29.443466 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:29.444181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:29.445116 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:29.445901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:29.446421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:29.447228 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:29.627800 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:29.639859 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-040f4368-f7db-4410-81ff-692ec02dcc06 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.208845 Sep 09 14:59:29.640440 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 153/298] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:29 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:29.734774 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:29.735410 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:29.741510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:29.742079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:29.742661 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:29.743431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:29.743894 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:29.744319 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:29.875567 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:29.883929 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:29.885412 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:29.886581 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb20bb29-316a-4bb9-9e90-4b77aca94a3d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.157210 Sep 09 14:59:29.887151 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 146/299] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:29 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:30.123895 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:30.124511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:30.131228 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:30.131719 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:30.132162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:30.132898 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:30.133390 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:30.133822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:30.273495 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:30.284790 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b954a648-05c9-44b9-bc09-0dfa14136387 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.164748 Sep 09 14:59:30.286251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 154/300] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:30 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:30.294483 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4c33cff5-998c-4ba8-8beb-23be1180990e req-21d66dfc-2544-4e4c-892a-e321d28dcd2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d7f23b-6ebe-4a3a-9c5d-47a52df51a92", "tag": "a6328979-e994-4108-87dc-e3b7e7729e74"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:30.303934 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4c33cff5-998c-4ba8-8beb-23be1180990e req-21d66dfc-2544-4e4c-892a-e321d28dcd2d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:30.304412 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4c33cff5-998c-4ba8-8beb-23be1180990e req-21d66dfc-2544-4e4c-892a-e321d28dcd2d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:30.304840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4c33cff5-998c-4ba8-8beb-23be1180990e req-21d66dfc-2544-4e4c-892a-e321d28dcd2d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:30.315915 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4c33cff5-998c-4ba8-8beb-23be1180990e req-21d66dfc-2544-4e4c-892a-e321d28dcd2d service nova] Creating event network-changed:a6328979-e994-4108-87dc-e3b7e7729e74 for instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 on hv-cinder-82869 Sep 09 14:59:30.320774 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4c33cff5-998c-4ba8-8beb-23be1180990e req-21d66dfc-2544-4e4c-892a-e321d28dcd2d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029888 Sep 09 14:59:30.321379 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 147/301] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:30.667994 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:30.669138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:30.674923 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:30.675402 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:30.675836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:30.676522 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:30.676970 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:30.677418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:30.813215 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:30.822085 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0025c3c0-4d3b-4686-b21c-c26b1a116399 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.157781 Sep 09 14:59:30.822681 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 155/302] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:30 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:30.912354 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:30.913500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:30.919813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:30.920293 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:30.920727 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:30.921445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:30.922062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:30.922481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:31.071009 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:31.074857 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:31.086993 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:31.088634 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:31.089859 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f6c4e1a-ecb3-4af3-86f8-e189337a5609 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.181793 Sep 09 14:59:31.090967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 148/303] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:30 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:31.308544 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:31.309870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:31.316435 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:31.316925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:31.317396 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:31.318102 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:31.318557 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:31.318983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:31.453933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:31.461516 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6920e737-1631-4da5-97c6-26f544f232db tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.157074 Sep 09 14:59:31.462080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 156/304] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:31 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:31.848939 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:31.850102 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:31.856618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:31.857104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:31.857781 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:31.859036 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:31.859888 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:31.860662 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:31.990632 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:31.998845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60519cb6-4155-4414-a052-c53ecc8f45a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.158013 Sep 09 14:59:31.999415 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 149/305] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:31 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:32.115821 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:32.116432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:32.118400 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=4 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:32.119182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=16 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:32.126676 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:32.127153 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:32.127583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:32.128269 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:32.128716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:32.129133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:32.264011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:32.272293 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:32.273801 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:32.274993 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0420916c-009e-4c25-bb72-4e4103c678ea tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.163049 Sep 09 14:59:32.275547 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 157/306] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:32 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:32.485240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:32.485773 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:32.487599 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:32.493137 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:32.493993 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:32.494743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:32.495968 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:32.497453 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:32.498387 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:32.723621 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:32.732194 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1572a1f-80f2-4033-b9f8-aa9c9687b60d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.251255 Sep 09 14:59:32.733039 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 150/307] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:32 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:33.022922 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:33.023538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:33.030889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:33.031592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:33.032067 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:33.032807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:33.033249 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:33.033683 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:33.283342 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:33.290983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7152724e-bd37-4359-bb22-f041f84f8f87 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.271851 Sep 09 14:59:33.291543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 158/308] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:33 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:33.301097 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:33.301842 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:33.308840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:33.309914 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:33.310353 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:33.311066 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:33.311521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:33.311944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:33.464439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:33.476420 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:33.478544 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:33.480043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-31e2d767-112f-4da7-9d15-a27f88ce041a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1745 microversion: 2.20 time: 0.182690 Sep 09 14:59:33.480534 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 151/309] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:33 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:33.755269 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:33.756174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:33.764880 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:33.765572 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:33.766319 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:33.767124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:33.767708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:33.768211 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:34.068164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:34.077755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f7d4b59-4d96-4adf-80c0-86df288d4bbd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.326228 Sep 09 14:59:34.078343 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 159/310] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:33 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:34.373392 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:34.374095 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:34.381512 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:34.382176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:34.382648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:34.383824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:34.384211 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:34.384637 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:34.506008 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:34.506627 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:34.514259 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:34.514749 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:34.515398 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:34.516115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:34.516576 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:34.516990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:34.980721 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:35.000130 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:35.003377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-927d0ef9-7347-4882-8026-284122d1e9b1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.633734 Sep 09 14:59:35.006614 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 152/311] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:34 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:35.021407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:35.022997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:35.024422 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e5a90f17-70b0-4580-a119-8d9bf400c40b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1745 microversion: 2.20 time: 0.522492 Sep 09 14:59:35.025710 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 160/312] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:34 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1745 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:35.101615 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:35.102577 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:35.109694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:35.113379 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:35.113379 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:35.113379 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:35.113379 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:35.113765 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:35.251944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:35.259730 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48b8bc39-1705-4db1-9aa2-60cc3c7f1e39 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1502 microversion: 2.1 time: 0.162776 Sep 09 14:59:35.260295 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 153/313] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:35 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:35.283742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ca85cd6-1083-4b0d-81ed-6b2fcabcdfb3"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:35.286475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:35.293054 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:35.293598 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:35.294038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:35.294750 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:35.295382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:35.295977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:35.319891 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] HTTP exception thrown: Cannot 'attach_volume' instance fbddff0a-cdd3-4537-821e-decd3714e96d while it is in vm_state rescued Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Request method failure captured: Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: POST /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d/os-volume_attachments HTTP/1.1 Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 74 Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RR0jZmzYl6UcfRkFayyMlevi0Iywujzul1Umo2IJj8q3R3lNGGST6iKANfvVW7rK8VRcV6ayKXynC7q16_zsSpfiOcWY5Slgmp6Lg9c49wKS-gTk5TuP8_XXNmBJqyxP7u__YCnrB3K2TOU22wbicKV1v5-TlXeMuJ9zAizqRmqT0 Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 14:59:35.322543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8051535f56a4e17a0fa1eeab7c08ce7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: cd6c40dd492e40599324ef05011895f3 Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {"volumeAttachment": {"volumeId": "9ca85cd6-1083-4b0d-81ed-6b2fcabcdfb3"}} Sep 09 14:59:35.324138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Cannot 'attach_volume' instance fbddff0a-cdd3-4537-821e-decd3714e96d while it is in vm_state rescued Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'server_id': 'fbddff0a-cdd3-4537-821e-decd3714e96d', 'body': {'volumeAttachment': {'volumeId': '9ca85cd6-1083-4b0d-81ed-6b2fcabcdfb3'}}} Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fbddff0a-cdd3-4537-821e-decd3714e96d in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 14:59:35.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fbddff0a-cdd3-4537-821e-decd3714e96d while it is in vm_state rescued Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 14:59:35.327034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 14:59:35.328322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 14:59:35.328322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 14:59:35.328322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fbddff0a-cdd3-4537-821e-decd3714e96d while it is in vm_state rescued Sep 09 14:59:35.328322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 14:59:35.328322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Returning 409 to user: Cannot 'attach_volume' instance fbddff0a-cdd3-4537-821e-decd3714e96d while it is in vm_state rescued {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 14:59:35.328322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b91fcd35-a2ed-4a25-bd2a-8bba24906473 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044297 Sep 09 14:59:35.328322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 161/314] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 14:59:35 2022] POST /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 14:59:35.335503 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2618b87-5193-4ed9-8188-0247336c2295 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:35.336357 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2618b87-5193-4ed9-8188-0247336c2295 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:35.346734 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2618b87-5193-4ed9-8188-0247336c2295 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:35.347584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2618b87-5193-4ed9-8188-0247336c2295 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:35.348029 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2618b87-5193-4ed9-8188-0247336c2295 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:35.348749 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2618b87-5193-4ed9-8188-0247336c2295 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:35.349227 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2618b87-5193-4ed9-8188-0247336c2295 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:35.349682 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2618b87-5193-4ed9-8188-0247336c2295 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:35.424871 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2618b87-5193-4ed9-8188-0247336c2295 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d/action" status: 202 len: 0 microversion: 2.1 time: 0.094637 Sep 09 14:59:35.426467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 154/315] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 14:59:35 2022] POST /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 14:59:35.435872 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:35.436864 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:35.443500 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:35.444722 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:35.445398 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:35.446303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:35.447021 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:35.447725 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:35.708646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:35.719140 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9d0d4d0d-0b3a-4809-9122-dd6f09f77260 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1510 microversion: 2.1 time: 0.288548 Sep 09 14:59:35.719714 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 162/316] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:35 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1510 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:36.031482 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:36.032176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:36.041254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:36.041966 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:36.043002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:36.044369 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:36.044934 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:36.046762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:36.054420 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:36.055155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:36.073339 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:36.073843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:36.074290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:36.075044 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:36.081909 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:36.082358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:36.362209 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:36.370157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:36.379977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:36.382042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:36.382925 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-821a6548-68b9-4906-97e5-a4c4f68f4849 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.356395 Sep 09 14:59:36.383511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 155/317] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:36 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:36.385338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ba8adec5-d960-4b2f-922a-9e915bc06234 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1740 microversion: 2.20 time: 0.335871 Sep 09 14:59:36.398082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 163/318] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:36 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1740 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:36.744253 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:36.745465 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:36.754245 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:36.755102 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:36.755745 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:36.756779 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:36.757340 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:36.758039 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:36.941571 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:36.955803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf9f586f-802a-4e86-829e-6e0305043148 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1510 microversion: 2.1 time: 0.216593 Sep 09 14:59:36.956784 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 156/319] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:36 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:37.407738 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:37.408890 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:37.415086 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:37.415923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:37.430621 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:37.431112 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:37.431548 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:37.432244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:37.432702 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:37.434558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:37.435213 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:37.437754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:37.438872 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:37.440397 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:37.441937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:37.445870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:37.753020 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:37.763033 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f3954b6b-c396-4f33-896d-f2abbd62e543 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.358284 Sep 09 14:59:37.764962 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:37.770291 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 164/320] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:37 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:37.776583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:37.779432 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:37.785556 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f0eaecc-44d2-4f96-8422-0d71a5f6a7be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1740 microversion: 2.20 time: 0.373453 Sep 09 14:59:37.786373 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 157/321] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:37 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1740 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:37.786946 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-c76703d1-d07a-428a-b77f-f716c49449a2 req-b49c5749-70e8-424c-a0ef-239da546ad4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9e901f-c6b3-4840-ae33-2953c8e39eee", "name": "network-vif-plugged", "status": "completed", "tag": "27073afa-d48f-4e5f-b5fb-94c6c6f9082c"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:37.804397 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-c76703d1-d07a-428a-b77f-f716c49449a2 req-b49c5749-70e8-424c-a0ef-239da546ad4a service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:37.805542 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-c76703d1-d07a-428a-b77f-f716c49449a2 req-b49c5749-70e8-424c-a0ef-239da546ad4a service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:37.806368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-c76703d1-d07a-428a-b77f-f716c49449a2 req-b49c5749-70e8-424c-a0ef-239da546ad4a service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:37.824292 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-c76703d1-d07a-428a-b77f-f716c49449a2 req-b49c5749-70e8-424c-a0ef-239da546ad4a service nova] Creating event network-vif-plugged:27073afa-d48f-4e5f-b5fb-94c6c6f9082c for instance af9e901f-c6b3-4840-ae33-2953c8e39eee on hv-cinder-82869 Sep 09 14:59:37.829850 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-c76703d1-d07a-428a-b77f-f716c49449a2 req-b49c5749-70e8-424c-a0ef-239da546ad4a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053958 Sep 09 14:59:37.830789 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 165/322] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:37.983730 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:37.984883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:37.992048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:37.992681 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:37.993257 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:37.996122 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:37.996888 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:37.997870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:38.187266 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:38.199136 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d72d9d4d-07be-46fd-af25-3dafc723bf52 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1510 microversion: 2.1 time: 0.216348 Sep 09 14:59:38.213319 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 158/323] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:37 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:38.787760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:38.788457 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:38.795949 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:38.796447 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:38.797138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:38.797964 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:38.798526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:38.798918 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:38.814052 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:38.814850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:38.822533 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:38.823177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:38.823739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:38.824625 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:38.825432 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:38.825851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:39.043829 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:39.054286 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fa5865a2-41c3-4acb-888b-9d4519c36d80 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.270806 Sep 09 14:59:39.058144 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 166/324] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:38 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:39.081336 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:39.091874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:39.094293 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:39.095975 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7e8eb4b-7b7c-4096-a386-c25995daabca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1740 microversion: 2.20 time: 0.287148 Sep 09 14:59:39.109225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 159/325] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:38 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:39.226164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:39.226780 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:39.243027 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:39.245472 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:39.247093 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:39.248965 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:39.250141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:39.251020 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:39.453774 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:39.477943 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6a88ae53-1f90-43dd-bfba-621acc77d541 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1510 microversion: 2.1 time: 0.256259 Sep 09 14:59:39.489230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 167/326] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:39 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:40.084016 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:40.084608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:40.093991 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:40.094701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:40.095295 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:40.096169 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:40.097043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:40.097845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:40.127475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:40.128747 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:40.140284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:40.143791 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:40.145814 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:40.146771 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:40.147386 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:40.147969 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:40.332229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:40.347701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50e1681c-1a6f-4ad7-a1f1-d54d6e010789 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.266799 Sep 09 14:59:40.349806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 160/327] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:40 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:40.413668 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:40.425460 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:40.426971 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:40.428394 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1a3f3caf-66d1-4b85-94bb-b2129d846354 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1740 microversion: 2.20 time: 0.306745 Sep 09 14:59:40.442830 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 168/328] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:40 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:40.501758 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:40.502366 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:40.515956 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:40.518656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:40.519301 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:40.521876 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:40.525089 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:40.526339 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:40.724274 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:40.734368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12ac1e9a-4a58-407a-b2b6-9fd5021cad2e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1516 microversion: 2.1 time: 0.236380 Sep 09 14:59:40.735690 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 161/329] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:40 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:41.373310 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:41.374998 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:41.403480 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:41.404425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:41.405095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:41.406542 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:41.408033 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:41.408716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:41.457481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:41.458650 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:41.468385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:41.469519 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:41.470284 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:41.471864 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:41.472504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:41.473091 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:41.751455 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:41.753885 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:41.763400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:41.765777 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:41.766948 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1a01e913-a36a-48e0-bb43-d87c152478c0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.397957 Sep 09 14:59:41.767434 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98b18c6a-7e10-41f5-b0bb-c097d1d87172 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1740 microversion: 2.20 time: 0.315502 Sep 09 14:59:41.768581 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 162/330] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:41 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:41.773577 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 169/331] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:41 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:42.253827 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b2c6210-2ad0-4820-81ee-47a6fb1f9e3f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'create', calling method: .version_select at 0x7f8ad3ec3f70>, body: {"keypair": {"name": "tempest-keypair-1222634823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrt998ROpCnD8e26M7aBSu89BCsrPV6PsJu8eaTwt4UMaPhWbXW9rMdsMPst1sy7E/yXTz3h12ZwlxPvA0p8xy0+ZBVs11GoJ1jsIa/WkZsa+8MJrZc49/jau7ox6jeKw=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:42.276876 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-6b2c6210-2ad0-4820-81ee-47a6fb1f9e3f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Getting quotas for project b8051535f56a4e17a0fa1eeab7c08ce7. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:59:42.281758 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-6b2c6210-2ad0-4820-81ee-47a6fb1f9e3f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Getting quotas for user cd6c40dd492e40599324ef05011895f3 and project b8051535f56a4e17a0fa1eeab7c08ce7. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:59:42.306313 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b2c6210-2ad0-4820-81ee-47a6fb1f9e3f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058939 Sep 09 14:59:42.307550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 163/332] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 14:59:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:42.790391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:42.791746 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:42.799256 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:42.799823 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:42.800350 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:42.801175 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:42.801493 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:42.801976 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:42.802244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:42.802937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:42.805785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:42.817023 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:42.817878 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:42.818503 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:42.819379 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:42.820132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:42.820708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:43.117591 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:43.133473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3848b00f-c24e-4bd1-93f2-b9c7920f6bf6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.347017 Sep 09 14:59:43.135237 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 170/333] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:42 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:43.183392 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:43.193891 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:43.196140 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:43.197583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c694ab4-7b09-4329-ab77-ba2d6d986f4e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1740 microversion: 2.20 time: 0.404952 Sep 09 14:59:43.198400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 164/334] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:42 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1740 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:44.099676 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1087811439", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a104187-cf4f-4fc2-83b7-d6fe24d794dc"}], "security_groups": [{"name": "tempest-securitygroup--1524041240"}], "key_name": "tempest-keypair-1222634823", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:44.158296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:44.159677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:44.167579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:44.168835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:44.169478 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:44.170192 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:44.170927 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:44.172517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:44.198762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:44.331250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:44.339602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02cd552b-fe08-453e-905f-88b61035d038 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.185390 Sep 09 14:59:44.340235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 165/335] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:44 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:44.349155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:44.349998 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:44.356886 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:44.357430 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:44.357874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:44.358570 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:44.359028 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:44.359456 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:44.498885 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:44.510702 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:44.513527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:44.514949 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec003130-d331-4916-8071-e9e33cbcbc07 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1740 microversion: 2.20 time: 0.173609 Sep 09 14:59:44.515781 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 166/336] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:44 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:45.364036 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:45.365887 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:45.383362 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:45.385635 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:45.386393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:45.388329 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:45.389058 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:45.389729 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:45.566456 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:45.581633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-155aae53-87b0-43f8-98be-e4dc17c2bd18 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.216985 Sep 09 14:59:45.593944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 167/337] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:45 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:45.600263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-415bc994-a590-4070-b4d2-010a16ddc624 req-b2356cac-9572-451f-b0dc-d48a9ca40b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de85eb6c-027b-4f9b-95e0-654217d6514e", "name": "network-vif-plugged", "status": "completed", "tag": "e3d39b24-1d9b-4caf-a284-b75b3c187cde"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:45.611047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-415bc994-a590-4070-b4d2-010a16ddc624 req-b2356cac-9572-451f-b0dc-d48a9ca40b90 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:45.611481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-415bc994-a590-4070-b4d2-010a16ddc624 req-b2356cac-9572-451f-b0dc-d48a9ca40b90 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:45.611915 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-415bc994-a590-4070-b4d2-010a16ddc624 req-b2356cac-9572-451f-b0dc-d48a9ca40b90 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:45.623869 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-415bc994-a590-4070-b4d2-010a16ddc624 req-b2356cac-9572-451f-b0dc-d48a9ca40b90 service nova] Creating event network-vif-plugged:e3d39b24-1d9b-4caf-a284-b75b3c187cde for instance de85eb6c-027b-4f9b-95e0-654217d6514e on hv-cinder-82869 Sep 09 14:59:45.629108 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-415bc994-a590-4070-b4d2-010a16ddc624 req-b2356cac-9572-451f-b0dc-d48a9ca40b90 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033728 Sep 09 14:59:45.630052 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 168/338] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:45.635015 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:45.635706 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:45.643384 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:45.643643 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:45.644041 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:45.644740 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:45.645191 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:45.645816 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:45.817345 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:45.833305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:45.835126 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:45.837811 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61a6bbb1-e034-4ef8-8e8a-2329b67bf39c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1740 microversion: 2.20 time: 0.205441 Sep 09 14:59:45.841923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 169/339] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:45 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:46.606233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:46.606903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:46.613829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:46.614324 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:46.614760 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:46.615456 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:46.615917 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:46.616342 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:46.772970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:46.781562 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eff62582-d647-40b1-bef7-7c5ffda579ca tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1259 microversion: 2.1 time: 0.179259 Sep 09 14:59:46.782512 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 170/340] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:46 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:46.795347 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] validate_networks() for [('6a104187-cf4f-4fc2-83b7-d6fe24d794dc', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 14:59:46.899084 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:46.899691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:46.905776 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:46.906256 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:46.906687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:46.907368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:46.907814 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:46.908256 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:47.130675 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:47.139685 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:47.141238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:47.142480 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-165c7b62-6680-4bf4-87a4-528f51647a3e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1740 microversion: 2.20 time: 0.247493 Sep 09 14:59:47.143049 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 171/341] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:46 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:47.233115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 14:59:47.233580 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 14:59:47.234054 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 14:59:47.234466 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 14:59:47.234876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 14:59:47.243993 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:47.244472 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:47.244903 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:47.245706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:47.246160 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:47.247195 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:47.267825 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Getting quotas for project b8051535f56a4e17a0fa1eeab7c08ce7. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 14:59:47.273730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Getting quotas for user cd6c40dd492e40599324ef05011895f3 and project b8051535f56a4e17a0fa1eeab7c08ce7. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 14:59:47.286405 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 14:59:47.288696 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 14:59:47.336991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d48c30c5-5df4-4371-b332-367400187075 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.241436 Sep 09 14:59:47.337664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 171/342] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 14:59:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 3243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 14:59:47.348981 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e50c22c4-b8c9-437e-84b1-55d64fed508c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:47.349624 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e50c22c4-b8c9-437e-84b1-55d64fed508c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:47.351567 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:47.406583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e50c22c4-b8c9-437e-84b1-55d64fed508c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:47.414080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e50c22c4-b8c9-437e-84b1-55d64fed508c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1246 microversion: 2.1 time: 0.069024 Sep 09 14:59:47.418613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 172/343] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:47 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:47.804971 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:47.805989 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:47.814284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:47.814771 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:47.815204 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:47.815898 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:47.816345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:47.816767 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:47.947202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:47.955474 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f092adfe-e33a-4078-b2f8-e9870163d8dd tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1442 microversion: 2.1 time: 0.155000 Sep 09 14:59:47.956031 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 172/344] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:47 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:47.978969 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:47.979574 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:47.986127 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:47.986541 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:47.986971 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:47.987646 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:47.988092 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:47.988508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:48.126032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:48.134644 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d18981b0-5746-4424-bf3b-4c496cbbee84 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1442 microversion: 2.1 time: 0.159234 Sep 09 14:59:48.135649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 173/345] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:47 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:48.169760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:48.176584 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:48.192352 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:48.192859 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:48.193330 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:48.194044 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:48.196395 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:48.197007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:48.437934 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:48.438558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:48.457393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:48.457894 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:48.458337 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:48.459073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:48.459834 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:48.459963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:48.646547 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:48.653990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:48.666133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:48.667841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-627f50da-ee73-415f-9dcd-dabc192cd242 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1242 microversion: 2.1 time: 0.234076 Sep 09 14:59:48.668922 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 174/346] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:48 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1242 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:48.670495 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:48.671764 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-24f31c79-431f-4629-ae82-cbf8d61dd69f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1722 microversion: 2.20 time: 0.506323 Sep 09 14:59:48.685627 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 173/347] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:48 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1722 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:49.695186 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:49.695906 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:49.698788 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:49.699903 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:49.703096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:49.703807 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:49.704425 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:49.705205 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:49.705732 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:49.706224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:49.706786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:49.707327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:49.707835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:49.708667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:49.709238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:49.709751 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:49.796467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:49.805862 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62fabdd7-f4e8-4712-882f-b3fcb6d66143 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1304 microversion: 2.1 time: 0.114608 Sep 09 14:59:49.806750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 175/348] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:49 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:49.868723 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:49.877611 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:49.879062 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:49.880230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dcc26be2-8a0c-4152-ab39-462f72bd6450 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1722 microversion: 2.20 time: 0.185503 Sep 09 14:59:49.880791 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 174/349] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:49 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:50.023312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-da702be6-b041-4d45-a0fa-eb28b68920aa req-2aab1ba8-f43e-4391-b65e-8ae2e79d1922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de85eb6c-027b-4f9b-95e0-654217d6514e", "tag": "e3d39b24-1d9b-4caf-a284-b75b3c187cde"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:50.034676 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-da702be6-b041-4d45-a0fa-eb28b68920aa req-2aab1ba8-f43e-4391-b65e-8ae2e79d1922 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:50.035085 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-da702be6-b041-4d45-a0fa-eb28b68920aa req-2aab1ba8-f43e-4391-b65e-8ae2e79d1922 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:50.035520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-da702be6-b041-4d45-a0fa-eb28b68920aa req-2aab1ba8-f43e-4391-b65e-8ae2e79d1922 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:50.047025 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-da702be6-b041-4d45-a0fa-eb28b68920aa req-2aab1ba8-f43e-4391-b65e-8ae2e79d1922 service nova] Creating event network-changed:e3d39b24-1d9b-4caf-a284-b75b3c187cde for instance de85eb6c-027b-4f9b-95e0-654217d6514e on hv-cinder-82869 Sep 09 14:59:50.051987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-da702be6-b041-4d45-a0fa-eb28b68920aa req-2aab1ba8-f43e-4391-b65e-8ae2e79d1922 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032331 Sep 09 14:59:50.052782 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 176/350] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:50.827889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:50.828504 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:50.835258 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:50.835816 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:50.836181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:50.836887 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:50.837363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:50.837782 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:50.901500 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:50.908416 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:50.909784 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:50.910710 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9b74f556-62c0-4084-93b1-6b94e95fada2 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1304 microversion: 2.1 time: 0.086621 Sep 09 14:59:50.911353 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 175/351] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:50 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:50.915928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:50.916412 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:50.916838 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:50.917834 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:50.918948 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:50.919501 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:51.054930 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:51.063803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:51.065269 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:51.066417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6aafb39d-c3ab-4bc3-af52-7516b47fa677 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1722 microversion: 2.20 time: 0.162698 Sep 09 14:59:51.066954 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 177/352] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:50 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:51.439171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-6541d421-4b51-4fa8-8fe9-dab5d7f412cb req-8769237b-4a81-47e7-8bba-1db8696c3b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9e901f-c6b3-4840-ae33-2953c8e39eee", "name": "network-vif-unplugged", "status": "completed", "tag": "27073afa-d48f-4e5f-b5fb-94c6c6f9082c"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:51.448504 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-6541d421-4b51-4fa8-8fe9-dab5d7f412cb req-8769237b-4a81-47e7-8bba-1db8696c3b9d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:51.448988 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-6541d421-4b51-4fa8-8fe9-dab5d7f412cb req-8769237b-4a81-47e7-8bba-1db8696c3b9d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:51.450158 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-6541d421-4b51-4fa8-8fe9-dab5d7f412cb req-8769237b-4a81-47e7-8bba-1db8696c3b9d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:51.461089 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-6541d421-4b51-4fa8-8fe9-dab5d7f412cb req-8769237b-4a81-47e7-8bba-1db8696c3b9d service nova] Creating event network-vif-unplugged:27073afa-d48f-4e5f-b5fb-94c6c6f9082c for instance af9e901f-c6b3-4840-ae33-2953c8e39eee on hv-cinder-82869 Sep 09 14:59:51.466031 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-6541d421-4b51-4fa8-8fe9-dab5d7f412cb req-8769237b-4a81-47e7-8bba-1db8696c3b9d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030561 Sep 09 14:59:51.466800 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 176/353] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:51.934213 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:51.934832 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:51.941347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:51.941838 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:51.942271 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:51.942963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:51.943414 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:51.943838 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:52.045562 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:52.053002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef351640-d7b1-4a56-b427-132e52b85a94 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1304 microversion: 2.1 time: 0.122730 Sep 09 14:59:52.053749 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 178/354] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:51 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:52.093083 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:52.093806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:52.100109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:52.100658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:52.101110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:52.101966 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:52.102437 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:52.102881 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:52.293916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:52.302306 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:52.303564 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:52.304715 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1e76187f-73a3-41fa-b835-66a40f817e1b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1725 microversion: 2.20 time: 0.216398 Sep 09 14:59:52.305321 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 177/355] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:52 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:52.329737 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8363ffb-493b-4882-ac34-3ac3253cfe69 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1baa5b7a-7661-4a6e-8d18-933c67f5dbc9"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:52.332558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8363ffb-493b-4882-ac34-3ac3253cfe69 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:52.340564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8363ffb-493b-4882-ac34-3ac3253cfe69 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:52.341063 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8363ffb-493b-4882-ac34-3ac3253cfe69 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:52.341525 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8363ffb-493b-4882-ac34-3ac3253cfe69 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:52.342226 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8363ffb-493b-4882-ac34-3ac3253cfe69 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:52.342672 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8363ffb-493b-4882-ac34-3ac3253cfe69 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:52.343127 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8363ffb-493b-4882-ac34-3ac3253cfe69 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:52.733672 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8363ffb-493b-4882-ac34-3ac3253cfe69 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.407752 Sep 09 14:59:52.734315 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 179/356] 10.222.0.15 () {62 vars in 1364 bytes} [Fri Sep 9 14:59:52 2022] POST /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments => generated 188 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 14:59:52.878511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:52.879119 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:52.885379 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:52.885871 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:52.886314 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:52.887646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:52.888105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:52.888538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:52.935853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120642) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 14:59:53.015768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-437673d9-4888-4214-8519-ce5332db271b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/action" status: 202 len: 0 microversion: 2.20 time: 0.140141 Sep 09 14:59:53.017164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 178/357] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Sep 9 14:59:52 2022] POST /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 14:59:53.028159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:53.029373 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:53.037360 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:53.038111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:53.038847 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:53.039903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:53.040542 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:53.041285 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:53.089396 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:53.090331 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:53.097934 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:53.099090 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:53.099531 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:53.100606 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:53.101234 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:53.101848 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:53.365344 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:53.371083 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:53.380597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-25b2141c-42b7-41c6-bf73-d368fdaeb960 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.308515 Sep 09 14:59:53.381474 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:53.383075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:53.384260 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-16b4bc51-831d-4128-86c3-9ad99fcc5612 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1751 microversion: 2.20 time: 0.363022 Sep 09 14:59:53.385093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 180/358] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:53 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1751 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:53.400425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 179/359] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:53 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:53.454133 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-362c2a9f-e2d0-4eef-8cc0-9f81b2cff80d req-37f59b7a-6719-40e5-8391-16fd4bb5cad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf7d1b4-008f-427e-afeb-a09b91f9c1a6", "tag": "598629db-7d01-4336-8d90-bf7ea717cd23"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:53.464352 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-362c2a9f-e2d0-4eef-8cc0-9f81b2cff80d req-37f59b7a-6719-40e5-8391-16fd4bb5cad9 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:53.465595 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-362c2a9f-e2d0-4eef-8cc0-9f81b2cff80d req-37f59b7a-6719-40e5-8391-16fd4bb5cad9 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:53.466037 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-362c2a9f-e2d0-4eef-8cc0-9f81b2cff80d req-37f59b7a-6719-40e5-8391-16fd4bb5cad9 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:53.485753 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-362c2a9f-e2d0-4eef-8cc0-9f81b2cff80d req-37f59b7a-6719-40e5-8391-16fd4bb5cad9 service nova] Creating event network-changed:598629db-7d01-4336-8d90-bf7ea717cd23 for instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 on hv-cinder-82869 Sep 09 14:59:53.494252 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-362c2a9f-e2d0-4eef-8cc0-9f81b2cff80d req-37f59b7a-6719-40e5-8391-16fd4bb5cad9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043996 Sep 09 14:59:53.494869 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 181/360] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 14:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:54.055638 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1e262a7e-0f1a-432e-a3b5-04e000e999ea tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:54.056135 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1e262a7e-0f1a-432e-a3b5-04e000e999ea tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:54.062354 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e262a7e-0f1a-432e-a3b5-04e000e999ea tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:54.062760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e262a7e-0f1a-432e-a3b5-04e000e999ea tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:54.063196 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e262a7e-0f1a-432e-a3b5-04e000e999ea tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:54.063892 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e262a7e-0f1a-432e-a3b5-04e000e999ea tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:54.064353 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e262a7e-0f1a-432e-a3b5-04e000e999ea tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:54.064780 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e262a7e-0f1a-432e-a3b5-04e000e999ea tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:54.088317 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1e262a7e-0f1a-432e-a3b5-04e000e999ea tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/ips" status: 200 len: 146 microversion: 2.1 time: 0.036497 Sep 09 14:59:54.088892 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 180/361] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 14:59:54 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:54.408628 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:54.409633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:54.414498 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:54.415104 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:54.415913 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:54.416402 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:54.416839 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:54.417568 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:54.418605 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:54.419039 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:54.422192 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:54.422672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:54.423105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:54.423792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:54.424248 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:54.424667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:54.436884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:54.843922 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:54.847829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:54.852507 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:54.853995 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:54.855165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-03264725-a621-4bce-9571-02c1f6fcbe11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1751 microversion: 2.20 time: 0.444567 Sep 09 14:59:54.855689 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ae605a1-22f4-403f-80ef-1f45e7cce977 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.451701 Sep 09 14:59:54.855807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 181/362] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:54 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1751 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:54.856242 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 182/363] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:54 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:55.878485 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:55.879099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:55.879955 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:55.881911 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:55.886620 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:55.887663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:55.888100 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:55.888800 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:55.889038 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:55.889298 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:55.889564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:55.889713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:55.890004 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:55.890712 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:55.891174 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:55.891597 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:56.117282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:56.122317 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:56.132236 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:56.134196 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:56.135678 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b842e121-cab3-443c-a981-9856a197c44f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1753 microversion: 2.20 time: 0.259807 Sep 09 14:59:56.136576 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 183/364] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:55 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1753 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 14:59:56.140925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3632a1bd-33dd-4207-9cc1-ddb948511b8e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.266345 Sep 09 14:59:56.145999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 182/365] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:55 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:57.162303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:57.163054 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:57.170315 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:57.170847 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:57.170937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:57.171312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:57.172004 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:57.172148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:57.172451 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:57.172873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:57.179951 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:57.180563 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:57.181111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:57.182275 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:57.182850 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:57.183395 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:57.255173 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:57.282451 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:57.414230 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:57.453242 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:57.459499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:57.463785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:57.466065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:57.467600 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3ae47a4-77ba-4bd7-ba71-896f20484e5e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.309239 Sep 09 14:59:57.481444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f182591-aa68-4b33-86b5-92a1bb203b2b tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.303998 Sep 09 14:59:57.481444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 183/366] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:57 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:57.481444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bfe83483-c6f3-4407-bbe2-7a9f916da02b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2e3d786-a82a-451a-a713-37ab4f54efef"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 14:59:57.481444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bfe83483-c6f3-4407-bbe2-7a9f916da02b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:57.482964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 184/367] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:57 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:57.492709 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfe83483-c6f3-4407-bbe2-7a9f916da02b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:57.493616 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfe83483-c6f3-4407-bbe2-7a9f916da02b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:57.494058 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfe83483-c6f3-4407-bbe2-7a9f916da02b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:57.494765 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfe83483-c6f3-4407-bbe2-7a9f916da02b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:57.495219 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfe83483-c6f3-4407-bbe2-7a9f916da02b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:57.495643 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bfe83483-c6f3-4407-bbe2-7a9f916da02b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:57.768671 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bfe83483-c6f3-4407-bbe2-7a9f916da02b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297064 Sep 09 14:59:57.769378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 184/368] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 14:59:57 2022] POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 14:59:58.497698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:58.499919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:58.504428 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:58.504909 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:58.505373 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:58.506077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:58.506189 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:58.506594 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:58.506936 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:58.507172 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:58.514621 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:58.515602 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:58.516292 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:58.517373 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:58.517937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:58.518467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:58.722870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:58.725550 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:58.733639 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2977ffc1-a607-4429-bca3-597d02430502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.232625 Sep 09 14:59:58.734196 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 185/369] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:58 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 14:59:58.741325 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:58.741325 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:58.741325 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57d183a3-4af7-43de-a536-5bcfa2d32710 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.247102 Sep 09 14:59:58.741877 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 185/370] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:58 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 14:59:59.756681 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:59.758381 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:59.766828 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 14:59:59.767417 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:59.768016 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 14:59:59.769628 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:59.770409 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:59.771096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:59.772291 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:59.772987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:59.773714 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:59.775501 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:59.776151 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:59.776735 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:59.778478 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 14:59:59.779084 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 14:59:59.779654 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 14:59:59.807121 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:59.987531 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:59.990503 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:59.996172 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:59.997883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 14:59:59.998241 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a724015f-50b0-4019-a2d7-b52f57a56172 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.246064 Sep 09 14:59:59.999033 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cc626ab-b096-40be-9b9a-aade9bb4265a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.236234 Sep 09 14:59:59.999161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 186/371] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 14:59:59 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 14:59:59.999988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 186/372] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 14:59:59 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:01.020991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:01.021870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:01.026967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:01.029444 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:01.030196 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:01.030813 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:01.031350 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:01.032358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:01.032920 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:01.033786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:01.037544 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:01.038502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:01.039413 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:01.040281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:01.040931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:01.041540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:01.240778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:01.248207 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:01.249078 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48ca5089-f996-48de-a7a0-697b274c5925 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.232113 Sep 09 15:00:01.249741 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 187/373] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:01 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:01.256853 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:01.258330 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:01.259480 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aaae3274-85c6-4e4d-a206-ed21d0fe8e90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.237429 Sep 09 15:00:01.260025 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 187/374] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:01 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:01.747017 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-c766a994-e222-4e6f-9417-db9d5ea08e26 req-6cd8f241-e77b-4abc-9c83-6e943c7c1533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf7d1b4-008f-427e-afeb-a09b91f9c1a6", "name": "network-vif-plugged", "status": "completed", "tag": "598629db-7d01-4336-8d90-bf7ea717cd23"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:01.757521 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-c766a994-e222-4e6f-9417-db9d5ea08e26 req-6cd8f241-e77b-4abc-9c83-6e943c7c1533 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:01.758004 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-c766a994-e222-4e6f-9417-db9d5ea08e26 req-6cd8f241-e77b-4abc-9c83-6e943c7c1533 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:01.758999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-c766a994-e222-4e6f-9417-db9d5ea08e26 req-6cd8f241-e77b-4abc-9c83-6e943c7c1533 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:01.777167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-c766a994-e222-4e6f-9417-db9d5ea08e26 req-6cd8f241-e77b-4abc-9c83-6e943c7c1533 service nova] Creating event network-vif-plugged:598629db-7d01-4336-8d90-bf7ea717cd23 for instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 on hv-cinder-82869 Sep 09 15:00:01.806815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-c766a994-e222-4e6f-9417-db9d5ea08e26 req-6cd8f241-e77b-4abc-9c83-6e943c7c1533 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063311 Sep 09 15:00:01.808001 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 188/375] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:00:02.274840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:02.276335 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:02.284597 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:02.285447 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:02.285881 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:02.286343 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:02.286588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:02.286903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:02.287517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:02.288100 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:02.293892 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:02.294588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:02.295031 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:02.295738 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:02.296190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:02.296844 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:02.529971 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:02.538850 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:02.540300 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:02.541494 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c33ca27e-c34e-4553-99ca-0bdd2fc9c1d5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.259745 Sep 09 15:00:02.542053 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 189/376] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:02 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:02.547627 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:02.555423 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e41b6fd8-ef09-4c93-bc4d-e6835c85db5e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.286730 Sep 09 15:00:02.556053 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 188/377] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:02 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:03.571494 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:03.572139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:03.579038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:03.579524 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:03.579960 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:03.580496 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:03.580979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:03.581100 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:03.581395 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:03.581575 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:03.588442 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:03.590065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:03.590811 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:03.595545 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:03.596031 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:03.596472 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:03.790530 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:03.793992 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:03.799553 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:03.801029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:03.802383 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9af1e218-31bc-4b84-b824-5a0532217e76 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.235810 Sep 09 15:00:03.802560 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3fca5de-2613-4f28-b3e0-727d6a9cc4bc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.225890 Sep 09 15:00:03.803555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 189/378] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:03 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:03.804707 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 190/379] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:03 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:04.832534 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:04.833279 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:04.833655 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:04.834268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:04.841459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:04.841948 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:04.842387 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:04.843095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:04.843724 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:04.844320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:04.849039 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:04.849786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:04.850302 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:04.851225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:04.851750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:04.856419 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:05.062093 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:05.064756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:05.072867 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:05.074378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e640590-ea22-41f5-a009-8e0b61088638 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.246234 Sep 09 15:00:05.081513 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 190/380] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:04 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:05.081740 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:05.081740 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-12fb2b0c-249c-4aed-8ba6-94acb4c3a3a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.250751 Sep 09 15:00:05.081740 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 191/381] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:04 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:00:06.098024 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:06.098633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:06.105808 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:06.106292 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:06.106607 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:06.107043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:06.107221 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:06.107387 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:06.107842 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:06.108264 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:06.115556 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:06.116064 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:06.116542 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:06.117252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:06.117704 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:06.118127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:06.327835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:06.335933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63fda746-f967-460b-88d6-86fe40aadf29 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.241680 Sep 09 15:00:06.336594 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 191/382] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:06 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:06.349901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:06.359526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:06.360978 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:06.362188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-842312d9-476a-4256-9d52-337f6924ac5f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.260064 Sep 09 15:00:06.362742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 192/383] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:06 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:00:07.358999 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:07.359614 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:07.367034 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:07.367693 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:07.368226 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:07.369417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:07.370082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:07.370609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:07.388071 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:07.389444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:07.399718 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:07.400217 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:07.400675 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:07.402917 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:07.404909 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:07.406514 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:07.599978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:07.608734 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f5786f0-017d-47e9-a176-d797faff09c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.253487 Sep 09 15:00:07.609507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 192/384] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:07 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:07.681591 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:07.691432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:07.693167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:07.694670 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6651b838-94a9-4019-aba0-4bf706f1b336 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.311772 Sep 09 15:00:07.695265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 193/385] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:07 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:08.631332 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:08.632041 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:08.639422 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:08.640137 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:08.640779 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:08.641502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:08.641963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:08.642383 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:08.721558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:08.722803 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:08.744733 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:08.747139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:08.747832 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:08.751419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:08.752112 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:08.752784 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:08.942783 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:08.955489 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-398a133b-6f71-40e5-a470-0c1729abdbd3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.327813 Sep 09 15:00:08.970527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 193/386] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:08 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:08.986145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:08.998980 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:09.002477 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:09.003991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-784a9f3a-32ba-4d99-ac64-e18fc64f7bf7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.287838 Sep 09 15:00:09.005363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 194/387] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:08 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:09.978335 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:09.978963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:09.985289 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:09.985771 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:09.986199 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:09.986883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:09.987331 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:09.987905 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:10.033403 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:10.034346 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:10.042206 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:10.042762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:10.043227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:10.043968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:10.045006 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:10.045624 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:10.164874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:10.174236 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3eedd27-659a-4328-b4d1-6a349e039364 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.199806 Sep 09 15:00:10.174824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 194/388] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:09 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:10.217084 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:10.226015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:10.227549 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:10.228792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a366aebe-3bc1-4a6f-a33a-9b271bd934f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.202467 Sep 09 15:00:10.229585 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 195/389] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:10 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:00:11.197958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:11.198599 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:11.205540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:11.206026 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:11.206461 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:11.207181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:11.207633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:11.208056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:11.254251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:11.254860 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:11.260967 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:11.261970 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:11.262404 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:11.263092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:11.263541 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:11.263961 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:11.379577 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:11.387658 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d717759e-5773-4a00-9548-8ac134456b3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.193516 Sep 09 15:00:11.388230 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 195/390] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:11 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:11.425300 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:11.438496 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:11.440216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:11.441471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a38f1c6a-24db-41dc-8b9d-616e22e57666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.191023 Sep 09 15:00:11.442187 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 196/391] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:11 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:00:12.411247 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:12.411852 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:12.418435 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:12.418915 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:12.419345 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:12.420049 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:12.420496 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:12.420912 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:12.467958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:12.468503 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:12.474851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:12.475336 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:12.475774 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:12.476469 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:12.476924 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:12.477389 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:12.590251 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:12.598031 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bdae63be-bfeb-40e4-9a80-cbf4c2a0cee3 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1372 microversion: 2.1 time: 0.190625 Sep 09 15:00:12.598611 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 196/392] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:12 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:12.635819 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:12.645015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:12.646504 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:12.647660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c59c768b-0717-4caf-a91c-bf01f5709d51 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.183734 Sep 09 15:00:12.648222 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 197/393] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:12 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:00:12.825497 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d42b878-bc23-4010-87dc-0ba54a667592 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:12.832126 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d42b878-bc23-4010-87dc-0ba54a667592 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:12.832617 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d42b878-bc23-4010-87dc-0ba54a667592 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:12.833131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d42b878-bc23-4010-87dc-0ba54a667592 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:12.892916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d42b878-bc23-4010-87dc-0ba54a667592 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Going to try to stop instance {{(pid=120643) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 15:00:12.934023 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d42b878-bc23-4010-87dc-0ba54a667592 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/action" status: 202 len: 0 microversion: 2.1 time: 0.113169 Sep 09 15:00:12.934779 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 197/394] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:00:12 2022] POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:00:12.942683 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:12.943313 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:12.949494 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:12.949987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:12.950428 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:12.951127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:12.951584 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:12.952013 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:13.083890 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:13.112734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5fabcee9-e6ef-4f0d-a6da-e7f6bf416dcf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.173737 Sep 09 15:00:13.113345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 198/395] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:12 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:13.624623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:13.625388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:13.632112 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:13.632598 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:13.633040 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:13.633770 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:13.634225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:13.634674 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:13.638683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:13.673680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:13.674385 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:13.681054 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:13.681656 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:13.682171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:13.682873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:13.683990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:13.684418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:14.019312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:14.027611 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cdd41092-7f7a-4e22-81f8-6968137ad62f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1565 microversion: 2.1 time: 0.407099 Sep 09 15:00:14.028494 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 198/396] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:13 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1565 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:14.052529 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e565f94-361e-48d1-8f6a-a6dfac3a47c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:14.053041 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e565f94-361e-48d1-8f6a-a6dfac3a47c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:14.060296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e565f94-361e-48d1-8f6a-a6dfac3a47c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:14.060844 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e565f94-361e-48d1-8f6a-a6dfac3a47c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:14.061705 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e565f94-361e-48d1-8f6a-a6dfac3a47c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:14.062647 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e565f94-361e-48d1-8f6a-a6dfac3a47c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:14.063306 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e565f94-361e-48d1-8f6a-a6dfac3a47c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:14.063948 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e565f94-361e-48d1-8f6a-a6dfac3a47c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:14.068095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:14.078731 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:14.080620 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:14.082190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f819c81e-e82f-4a04-8fa1-e0ca2c7eb7f3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.412529 Sep 09 15:00:14.083766 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 199/397] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:13 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:00:14.136156 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:14.137374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:14.148815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:14.149345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:14.149795 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:14.150873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:14.151357 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:14.151780 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:14.172994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e565f94-361e-48d1-8f6a-a6dfac3a47c7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125082 Sep 09 15:00:14.173635 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 199/398] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 15:00:14 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:00:14.315300 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:14.325268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e187a10d-cfab-46b3-96d0-51cba77cc595 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.193173 Sep 09 15:00:14.325846 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 200/399] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:14 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:00:15.113310 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:15.113914 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:15.119793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:15.120273 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:15.121354 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:15.122042 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:15.122490 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:15.122904 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:15.255499 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:15.264414 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:15.266121 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:15.267351 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5545b944-5a2a-4bab-8bb8-0fe832ed28bf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.158587 Sep 09 15:00:15.267850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 200/400] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:15 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:15.350045 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:15.352205 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:15.364686 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:15.365429 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:15.365872 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:15.366604 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:15.367059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:15.367510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:15.370296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-446536b1-d962-4c6f-a793-3230fe9955e9 req-c8ae0f6b-20c8-4ecf-a16b-aac2346c9b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf7d1b4-008f-427e-afeb-a09b91f9c1a6", "tag": "598629db-7d01-4336-8d90-bf7ea717cd23"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:15.380240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-446536b1-d962-4c6f-a793-3230fe9955e9 req-c8ae0f6b-20c8-4ecf-a16b-aac2346c9b98 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:15.381170 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-446536b1-d962-4c6f-a793-3230fe9955e9 req-c8ae0f6b-20c8-4ecf-a16b-aac2346c9b98 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:15.381756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-446536b1-d962-4c6f-a793-3230fe9955e9 req-c8ae0f6b-20c8-4ecf-a16b-aac2346c9b98 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:15.394077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-446536b1-d962-4c6f-a793-3230fe9955e9 req-c8ae0f6b-20c8-4ecf-a16b-aac2346c9b98 service nova] Creating event network-changed:598629db-7d01-4336-8d90-bf7ea717cd23 for instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 on hv-cinder-82869 Sep 09 15:00:15.400804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-446536b1-d962-4c6f-a793-3230fe9955e9 req-c8ae0f6b-20c8-4ecf-a16b-aac2346c9b98 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033584 Sep 09 15:00:15.401688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 201/401] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:00:15.605190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:15.618602 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e9881add-90a0-4eaa-ab5e-16d8780b5587 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.274268 Sep 09 15:00:15.619467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 201/402] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:15 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:16.295082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:16.295785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:16.303694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:16.304193 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:16.304635 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:16.305378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:16.305837 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:16.306267 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:16.436646 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:16.445872 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:16.447319 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:16.448512 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e10bc452-26b8-4475-8e45-a3d6a6630366 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.158464 Sep 09 15:00:16.449590 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 202/403] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:16 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:16.643077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:16.643753 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:16.650476 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:16.651055 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:16.651561 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:16.653260 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:16.653787 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:16.654281 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:16.783364 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:16.791487 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9a2c98a1-23ee-4ac5-90cc-450e06bab9c1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.152208 Sep 09 15:00:16.792051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 202/404] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:16 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:17.475474 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:17.476077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:17.478551 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=64 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:17.483774 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:17.484252 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:17.484968 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:17.485674 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:17.486124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:17.486542 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:17.622501 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:17.630921 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:17.632350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:17.633513 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a913f9c8-5445-4a23-9e5d-0a72ef3a2600 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.161909 Sep 09 15:00:17.634077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 203/405] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:17 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:17.814572 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:17.815193 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:17.821682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:17.822169 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:17.822614 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:17.823303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:17.824395 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:17.824829 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:17.839385 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:17.962805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:17.971254 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7b0d031c-3bdd-4be6-abf0-4334b71f379b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.160489 Sep 09 15:00:17.971823 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 203/406] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:17 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:18.659760 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:18.660346 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:18.666875 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:18.668020 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:18.668479 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:18.669162 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:18.669725 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:18.670142 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:18.799694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:18.808873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:18.810355 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:18.811504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0bef758-8a98-42a0-90d9-fb0ac5b0edfa tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.155713 Sep 09 15:00:18.812057 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 204/407] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:18 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:18.994285 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:18.994894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:19.002111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:19.002624 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:19.003061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:19.003748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:19.004197 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:19.004619 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:19.152424 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:19.160752 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b1c5724b-a4c8-4664-8896-35e91903e02d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.170320 Sep 09 15:00:19.161345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 204/408] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:18 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:19.835815 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:19.836415 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:19.843178 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:19.843653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:19.844084 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:19.844765 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:19.845234 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:19.845652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:19.989541 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:19.998806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:20.000318 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:20.001597 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b207c49-18d9-46c8-8c7a-ee903ac0f3f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.169582 Sep 09 15:00:20.002244 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 205/409] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:19 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:20.185914 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:20.186592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:20.194491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:20.195103 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:20.195844 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:20.196623 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:20.197320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:20.197766 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:20.363913 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:20.374890 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d79f26c1-53f1-43a7-9710-1837b7419631 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.193799 Sep 09 15:00:20.375670 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 205/410] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:20 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:21.028123 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:21.028755 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:21.035254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:21.035746 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:21.036181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:21.036870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:21.037351 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:21.037778 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:21.163944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:21.172977 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:21.174462 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:21.175622 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-969e31c6-a2af-47a2-bf77-2ba45d2ab885 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.152278 Sep 09 15:00:21.176189 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 206/411] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:21 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:21.400051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:21.400713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:21.411399 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:21.412049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:21.412600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:21.413440 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:21.414017 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:21.414586 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:21.615596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:21.624704 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ac262635-903a-480b-ab3c-a78a285cbc43 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.229851 Sep 09 15:00:21.625308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 206/412] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:21 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:00:22.201908 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:22.202490 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:22.208423 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:22.209365 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:22.209800 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:22.210495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:22.210955 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:22.212098 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:22.346080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:22.354611 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:22.356720 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:22.357940 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bc3959c-0b6f-4a14-bfca-a88ced89fe6a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.160463 Sep 09 15:00:22.358501 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 207/413] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:22 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:00:22.651549 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:22.652739 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:22.659482 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:22.659974 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:22.660418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:22.661125 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:22.661618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:22.662055 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:22.793541 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:22.801646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d57cce5f-5144-4350-896f-474ad1afd63f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.154138 Sep 09 15:00:22.802207 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 207/414] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:22 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:23.383222 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:23.383834 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:23.390185 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:23.390667 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:23.391101 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:23.391786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:23.392237 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:23.392659 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:23.517541 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:23.526047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:23.528276 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:23.529448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3f638a0-6e2e-4676-bab8-171485364533 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.150086 Sep 09 15:00:23.530009 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 208/415] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:23 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:23.826105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:23.826889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:23.833484 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:23.833972 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:23.834407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:23.835236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:23.835697 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:23.836119 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:23.983368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:23.991829 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fd872a8f-69fa-45ea-9a74-2b18c375bdd3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.169904 Sep 09 15:00:23.992499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 208/416] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:23 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:00:24.555299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:24.555818 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:24.562319 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:24.562799 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:24.563247 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:24.564312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:24.564683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:24.565130 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:24.696670 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:24.705697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:24.707126 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:24.708264 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fe485c3-302e-489d-bbf8-d4ebeba72cec tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.156983 Sep 09 15:00:24.708822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 209/417] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:24 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:25.017434 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:25.017823 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:25.024123 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.024607 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.025079 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.025805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.026283 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.026711 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.157371 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:25.165815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e9a70cd-7f7a-485d-aac9-aa19cccaaebb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.153567 Sep 09 15:00:25.166377 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 209/418] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:25 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:25.735153 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:25.735795 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:25.742524 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.743018 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.743454 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.744234 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.744688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.745111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.746587 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ee6b8d04-4111-4d22-9d03-6c39b0cdc0c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:25.747122 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ee6b8d04-4111-4d22-9d03-6c39b0cdc0c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:25.753401 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6b8d04-4111-4d22-9d03-6c39b0cdc0c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.753889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6b8d04-4111-4d22-9d03-6c39b0cdc0c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.754326 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6b8d04-4111-4d22-9d03-6c39b0cdc0c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.755311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6b8d04-4111-4d22-9d03-6c39b0cdc0c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.755651 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6b8d04-4111-4d22-9d03-6c39b0cdc0c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.756154 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6b8d04-4111-4d22-9d03-6c39b0cdc0c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.783947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ee6b8d04-4111-4d22-9d03-6c39b0cdc0c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92/ips" status: 200 len: 150 microversion: 2.1 time: 0.041170 Sep 09 15:00:25.785750 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 210/419] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 15:00:25 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:00:25.797845 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85e3cae2-6606-4f51-9ad0-daf84ff93ef6"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:25.800310 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:25.806371 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.806858 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.807296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.808880 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.809382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.809811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.887188 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:25.901425 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:25.902790 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:25.903306 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Invalid volume: volume 85e3cae2-6606-4f51-9ad0-daf84ff93ef6 is already attached to instances: 70c93a5b-944b-43a7-95f6-e49c229603b6 Sep 09 15:00:25.904227 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7fb3efc3-f5f9-4357-84fd-5f936c69b220 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.173805 Sep 09 15:00:25.904785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 210/420] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:25 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: POST /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92/os-volume_attachments HTTP/1.1 Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 74 Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:00:25.905916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {"volumeAttachment": {"volumeId": "85e3cae2-6606-4f51-9ad0-daf84ff93ef6"}} Sep 09 15:00:25.907251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Invalid volume: volume 85e3cae2-6606-4f51-9ad0-daf84ff93ef6 is already attached to instances: 70c93a5b-944b-43a7-95f6-e49c229603b6 Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'server_id': '85d7f23b-6ebe-4a3a-9c5d-47a52df51a92', 'body': {'volumeAttachment': {'volumeId': '85e3cae2-6606-4f51-9ad0-daf84ff93ef6'}}} Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 85e3cae2-6606-4f51-9ad0-daf84ff93ef6 is already attached to instances: 70c93a5b-944b-43a7-95f6-e49c229603b6 Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:25.908015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 85e3cae2-6606-4f51-9ad0-daf84ff93ef6 is already attached to instances: 70c93a5b-944b-43a7-95f6-e49c229603b6 Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:00:25.909141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:00:25.910368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:00:25.910368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:00:25.910368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:00:25.910368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 85e3cae2-6606-4f51-9ad0-daf84ff93ef6 is already attached to instances: 70c93a5b-944b-43a7-95f6-e49c229603b6 Sep 09 15:00:25.910368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:25.910368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 400 to user: Invalid volume: volume 85e3cae2-6606-4f51-9ad0-daf84ff93ef6 is already attached to instances: 70c93a5b-944b-43a7-95f6-e49c229603b6 {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:00:25.910368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-700f91d3-f3a2-43b1-a058-eedd7ccad962 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113592 Sep 09 15:00:25.910368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 211/421] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:00:25 2022] POST /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 15:00:25.914331 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-1fa5af8a-5520-4b7e-8fed-e3d83d855a8a req-6546229e-e5bf-416c-9ace-c275f203baf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9e901f-c6b3-4840-ae33-2953c8e39eee", "name": "network-vif-plugged", "status": "completed", "tag": "27073afa-d48f-4e5f-b5fb-94c6c6f9082c"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:25.916085 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:25.916583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:25.923347 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.923837 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.924287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.924579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1fa5af8a-5520-4b7e-8fed-e3d83d855a8a req-6546229e-e5bf-416c-9ace-c275f203baf5 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.924991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:25.925101 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1fa5af8a-5520-4b7e-8fed-e3d83d855a8a req-6546229e-e5bf-416c-9ace-c275f203baf5 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.925480 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:25.925590 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1fa5af8a-5520-4b7e-8fed-e3d83d855a8a req-6546229e-e5bf-416c-9ace-c275f203baf5 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.925915 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:25.937389 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-1fa5af8a-5520-4b7e-8fed-e3d83d855a8a req-6546229e-e5bf-416c-9ace-c275f203baf5 service nova] Creating event network-vif-plugged:27073afa-d48f-4e5f-b5fb-94c6c6f9082c for instance af9e901f-c6b3-4840-ae33-2953c8e39eee on hv-cinder-82869 Sep 09 15:00:25.943032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-1fa5af8a-5520-4b7e-8fed-e3d83d855a8a req-6546229e-e5bf-416c-9ace-c275f203baf5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036477 Sep 09 15:00:25.943751 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 211/422] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:00:25.954080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:00:26.032177 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-77ac69ad-eefc-493a-9b50-011f9a96535a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 204 len: 0 microversion: 2.1 time: 0.119431 Sep 09 15:00:26.032783 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 212/423] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:00:25 2022] DELETE /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:00:26.041473 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:26.042171 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:26.048346 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:26.048831 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:26.049303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:26.049990 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:26.050440 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:26.050880 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:26.182454 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:26.190203 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:26.190681 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49f22deb-7b8f-45ed-8a5b-d2ad19f9f1fc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1680 microversion: 2.1 time: 0.153443 Sep 09 15:00:26.190905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:26.191236 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 212/424] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:26 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:26.196711 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:26.197193 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:26.197664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:26.198355 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:26.198810 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:26.199239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:26.336243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:26.344453 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-13123fcc-b805-4fc8-9646-c88bb102b2fc tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.158991 Sep 09 15:00:26.345028 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 213/425] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:26 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:00:26.930666 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:26.931301 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:26.937878 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:26.938357 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:26.938793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:26.939472 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:26.939916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:26.940333 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:27.070028 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:27.078467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:27.079905 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:27.081058 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8191dfdc-d3c6-47c2-b255-9c43faf72f50 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.154272 Sep 09 15:00:27.081657 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 213/426] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:26 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:27.216206 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:27.216767 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:27.223679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:27.224162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:27.224601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:27.225319 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:27.225781 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:27.226208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:27.361495 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:27.368217 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:27.368825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:27.369179 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-54d75217-80a0-41fc-9a1d-af96d32a27f7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1680 microversion: 2.1 time: 0.156903 Sep 09 15:00:27.369785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 214/427] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:27 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:27.374702 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:27.375199 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:27.375854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:27.376683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:27.377326 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:27.377755 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:27.506181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:27.514963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f31e768-1f8f-4a74-b202-ba4f9290d7b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.150536 Sep 09 15:00:27.515515 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 214/428] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:27 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:00:28.106686 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:28.107301 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:28.113867 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:28.114351 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:28.114786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:28.115478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:28.115937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:28.116353 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:28.245649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:28.255232 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:28.256662 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:28.257893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-46693cd6-35b2-4289-8150-bc8efda6ea90 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.155110 Sep 09 15:00:28.258449 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 215/429] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:28 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:28.392087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:28.392695 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:28.399148 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:28.399627 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:28.400061 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:28.400736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:28.401181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:28.401620 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:28.529250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:28.537560 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c8f5bba-49b9-4ba4-91b2-6477ff259f9b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1680 microversion: 2.1 time: 0.149325 Sep 09 15:00:28.538160 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 215/430] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:28 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:28.541095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:28.543423 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:28.550129 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:28.550642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:28.551227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:28.551979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:28.552428 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:28.552882 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:28.687602 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:28.695732 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3365faf7-2f38-4c25-b29b-d8ced313296f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.159820 Sep 09 15:00:28.696300 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 216/431] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:28 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:00:29.283591 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:29.284110 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:29.290352 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:29.290846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:29.291279 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:29.291982 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:29.292429 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:29.292849 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:29.315780 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:29.542738 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:29.553236 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:29.563048 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:29.563749 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:29.571052 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:29.572439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2fb23e3e-6682-40ab-a79b-7feaa3c779e3 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1809 microversion: 2.20 time: 0.292883 Sep 09 15:00:29.573237 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 216/432] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:29 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:29.587701 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:29.588195 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:29.592710 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:29.593745 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:29.594227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:29.594665 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:29.723719 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:29.725128 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:29.734575 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:29.735702 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:29.736783 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:29.737877 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:29.738896 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:29.739333 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:29.907481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:29.916533 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ba01fe02-7c19-4b2f-b6c7-ef565317c17c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1680 microversion: 2.1 time: 0.358917 Sep 09 15:00:29.924547 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 217/433] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:29 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1680 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:00:30.044531 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:30.059124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d212f677-539d-4046-ae73-e376710c2b9e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.342671 Sep 09 15:00:30.059958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 217/434] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:29 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:30.243481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-0d70242b-a410-406f-a4de-e2b96fc51a9c req-92ff04c8-de4b-4371-b4a8-6b63f4d28fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d7f23b-6ebe-4a3a-9c5d-47a52df51a92", "name": "network-vif-deleted", "tag": "a6328979-e994-4108-87dc-e3b7e7729e74"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:30.251980 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:30.256905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-0d70242b-a410-406f-a4de-e2b96fc51a9c req-92ff04c8-de4b-4371-b4a8-6b63f4d28fb6 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:30.257666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-0d70242b-a410-406f-a4de-e2b96fc51a9c req-92ff04c8-de4b-4371-b4a8-6b63f4d28fb6 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:30.258355 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-0d70242b-a410-406f-a4de-e2b96fc51a9c req-92ff04c8-de4b-4371-b4a8-6b63f4d28fb6 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:30.274263 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-0d70242b-a410-406f-a4de-e2b96fc51a9c req-92ff04c8-de4b-4371-b4a8-6b63f4d28fb6 service nova] Creating event network-vif-deleted:a6328979-e994-4108-87dc-e3b7e7729e74 for instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 on hv-cinder-82869 Sep 09 15:00:30.284734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-0d70242b-a410-406f-a4de-e2b96fc51a9c req-92ff04c8-de4b-4371-b4a8-6b63f4d28fb6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045484 Sep 09 15:00:30.290171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 218/435] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:00:30.601550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:30.603604 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:30.611306 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:30.611785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:30.612214 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:30.613058 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:30.613598 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:30.614065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:30.776808 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:30.787236 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:30.790225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:30.791918 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5020da5-0621-45db-9c63-cf0b52b09dbb tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1796 microversion: 2.20 time: 0.194756 Sep 09 15:00:30.793215 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 218/436] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:00:30 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1796 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:00:30.942106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:30.942894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:30.949127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:30.949722 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:30.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:30.951028 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:30.951560 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:30.952675 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:30.973418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:30.996001 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:30.996581 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:30.997092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:30.997639 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lazy-loading 'fault' on Instance uuid 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:00:31.045248 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:31.054586 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b6fa1a8f-385e-44e7-a159-bef222e0cad3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 200 len: 1330 microversion: 2.1 time: 0.117169 Sep 09 15:00:31.055714 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 219/437] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:30 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 1330 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:31.083668 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:31.084329 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:31.090529 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:31.091110 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:31.091569 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:31.092253 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:31.092703 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:31.093159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:31.266495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:31.275020 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a1acfc2-9267-4d70-a612-54083fa32e12 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.195922 Sep 09 15:00:31.285651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 219/438] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:31 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:32.081933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:32.082538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:32.089217 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:32.089711 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:32.090147 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:32.090872 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:32.091326 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:32.091746 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:32.105134 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 HTTP/1.1 Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:00:32.106762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:00:32.108208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '85d7f23b-6ebe-4a3a-9c5d-47a52df51a92'} Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:00:32.109066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:00:32.110302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:00:32.111295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:00:32.111295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e7bfc695-8f93-48aa-b9ca-9d23c735907d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 404 len: 111 microversion: 2.1 time: 0.030070 Sep 09 15:00:32.111295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 220/439] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:32 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:00:32.116966 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9f4fe54-33f0-4632-b126-dab0eba57ca9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '.version_select at 0x7f8ad2adc3a0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:32.137534 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9f4fe54-33f0-4632-b126-dab0eba57ca9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280715033" status: 202 len: 0 microversion: 2.1 time: 0.024275 Sep 09 15:00:32.138117 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 220/440] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Sep 9 15:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280715033 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:00:32.302860 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:32.304265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:32.320835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:32.321364 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:32.321942 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:32.322666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:32.323125 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:32.323553 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:32.475076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:32.483979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dddde7ec-df06-459d-8c25-666568f0cf1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.188088 Sep 09 15:00:32.484626 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 221/441] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:32 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:32.861508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:32.861997 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:32.867895 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:32.868375 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:32.868804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:32.869517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:32.869968 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:32.870387 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:33.002606 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lazy-loading 'services' on Instance uuid 70c93a5b-944b-43a7-95f6-e49c229603b6 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:00:33.127745 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ca7e8ab-9229-43de-8ed7-01a74e67240e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-volume_attachments/85e3cae2-6606-4f51-9ad0-daf84ff93ef6" status: 202 len: 0 microversion: 2.1 time: 0.270639 Sep 09 15:00:33.128418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 221/442] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:00:32 2022] DELETE /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-volume_attachments/85e3cae2-6606-4f51-9ad0-daf84ff93ef6 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:00:33.136603 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eff09840-66f7-4d9d-b2e6-da85c01e5cf6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:33.138846 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eff09840-66f7-4d9d-b2e6-da85c01e5cf6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:33.145230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff09840-66f7-4d9d-b2e6-da85c01e5cf6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:33.145989 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff09840-66f7-4d9d-b2e6-da85c01e5cf6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:33.146424 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff09840-66f7-4d9d-b2e6-da85c01e5cf6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:33.147193 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff09840-66f7-4d9d-b2e6-da85c01e5cf6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:33.147595 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff09840-66f7-4d9d-b2e6-da85c01e5cf6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:33.148006 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff09840-66f7-4d9d-b2e6-da85c01e5cf6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:33.179194 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eff09840-66f7-4d9d-b2e6-da85c01e5cf6 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046452 Sep 09 15:00:33.179930 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 222/443] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:00:33 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:00:33.513372 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:33.513977 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:33.521071 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:33.521581 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:33.522020 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:33.522733 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:33.523187 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:33.523611 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:33.652861 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:33.661912 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a3ec6e9-4f62-45ab-8ca4-317aa8b8f71d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1723 microversion: 2.1 time: 0.152406 Sep 09 15:00:33.662512 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 222/444] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:33 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:34.195318 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-53e80e84-e976-4a83-98a5-730d40793ae3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:34.198167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-53e80e84-e976-4a83-98a5-730d40793ae3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:34.205244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e80e84-e976-4a83-98a5-730d40793ae3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.205397 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e80e84-e976-4a83-98a5-730d40793ae3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.205784 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e80e84-e976-4a83-98a5-730d40793ae3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.206853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e80e84-e976-4a83-98a5-730d40793ae3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.207360 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e80e84-e976-4a83-98a5-730d40793ae3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.208108 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e80e84-e976-4a83-98a5-730d40793ae3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.243082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-53e80e84-e976-4a83-98a5-730d40793ae3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054183 Sep 09 15:00:34.243727 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 223/445] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:00:34 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 15:00:34.313396 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:34.313943 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:34.320167 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.320653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.321093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.321834 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.322288 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.322712 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.348068 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:00:34.423198 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d9670a2-d2ac-4694-88a9-96253e41c80e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 204 len: 0 microversion: 2.1 time: 0.114917 Sep 09 15:00:34.423794 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 223/446] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:00:34 2022] DELETE /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:00:34.432335 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:34.432944 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:34.438788 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.439273 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.439711 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.440399 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.440854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.441300 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.573116 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:34.580968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fd20219f-7ab3-4a75-a0ae-8344fa600142 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1680 microversion: 2.1 time: 0.152615 Sep 09 15:00:34.581557 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 224/447] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:34 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:34.684843 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:34.685552 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:34.692095 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.692581 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.693014 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.693743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.694214 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.694666 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.836192 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:34.845009 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b8f246c-ae21-4098-9f8a-a72d96058bca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1700 microversion: 2.1 time: 0.164514 Sep 09 15:00:34.845605 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 224/448] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:34 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1700 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:34.868351 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4d560bd-0d2b-4e72-80f8-e849158e10b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:34.874397 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4d560bd-0d2b-4e72-80f8-e849158e10b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.874885 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4d560bd-0d2b-4e72-80f8-e849158e10b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.875327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4d560bd-0d2b-4e72-80f8-e849158e10b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.935069 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c4d560bd-0d2b-4e72-80f8-e849158e10b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Going to try to start instance {{(pid=120642) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 15:00:34.978377 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4d560bd-0d2b-4e72-80f8-e849158e10b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/action" status: 202 len: 0 microversion: 2.1 time: 0.113716 Sep 09 15:00:34.979137 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 225/449] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:00:34 2022] POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 15:00:34.987082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:34.987687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:34.994913 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.995448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.995883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:34.996587 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:34.997262 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:34.997739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:35.132543 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:35.141555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ddc38ef-0c5c-41dc-835c-9955a3bb2f70 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1709 microversion: 2.1 time: 0.158159 Sep 09 15:00:35.142201 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 225/450] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:34 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:35.605894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:35.606620 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:35.613778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:35.614264 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:35.614725 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:35.615398 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:35.615857 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:35.616283 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:35.774423 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:35.783091 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a9b60d95-85c1-4c8d-9659-1cc18eb933b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1680 microversion: 2.1 time: 0.181459 Sep 09 15:00:35.794955 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 226/451] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:35 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:36.165688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:36.166298 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:36.173337 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:36.173821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:36.174257 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:36.174984 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:36.175436 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:36.175854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:36.397929 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:36.406932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a6d80f0-a73b-47e6-bdb3-c6ae63384a18 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1709 microversion: 2.1 time: 0.245545 Sep 09 15:00:36.407642 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 226/452] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:36 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1709 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:36.806367 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:36.807030 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:36.814502 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:36.814988 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:36.815430 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:36.816129 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:36.816584 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:36.817005 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:37.119133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:37.127430 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-da3410d0-8474-43f7-8735-caed4834c3dc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1680 microversion: 2.1 time: 0.324968 Sep 09 15:00:37.127998 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 227/453] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:36 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1680 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:00:37.431597 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:37.432212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:37.438688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:37.439169 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:37.439609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:37.440300 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:37.440785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:37.441390 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:37.667726 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:37.676575 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-df363ef8-4026-4b4a-9d35-67521bb4290e tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1709 microversion: 2.1 time: 0.249797 Sep 09 15:00:37.677242 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 227/454] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:37 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1709 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:37.829649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-145c251f-76b5-4e74-a453-e56296a62080 req-dd44e022-9104-447c-b1cd-f9ff82598c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c93a5b-944b-43a7-95f6-e49c229603b6", "name": "network-vif-deleted", "tag": "17769411-6be9-4b42-9e21-4af2ee1d89cc"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:37.846135 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-145c251f-76b5-4e74-a453-e56296a62080 req-dd44e022-9104-447c-b1cd-f9ff82598c53 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:37.846623 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-145c251f-76b5-4e74-a453-e56296a62080 req-dd44e022-9104-447c-b1cd-f9ff82598c53 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:37.847061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-145c251f-76b5-4e74-a453-e56296a62080 req-dd44e022-9104-447c-b1cd-f9ff82598c53 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:37.861339 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-145c251f-76b5-4e74-a453-e56296a62080 req-dd44e022-9104-447c-b1cd-f9ff82598c53 service nova] Creating event network-vif-deleted:17769411-6be9-4b42-9e21-4af2ee1d89cc for instance 70c93a5b-944b-43a7-95f6-e49c229603b6 on hv-cinder-82869 Sep 09 15:00:37.867967 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-145c251f-76b5-4e74-a453-e56296a62080 req-dd44e022-9104-447c-b1cd-f9ff82598c53 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042136 Sep 09 15:00:37.869322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 228/455] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:00:38.152359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:38.154620 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:38.167826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:38.168570 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:38.169321 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:38.170500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:38.170970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:38.171411 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:38.204905 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:38.205425 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:38.205869 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:38.206327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lazy-loading 'fault' on Instance uuid 70c93a5b-944b-43a7-95f6-e49c229603b6 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:00:38.249229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:38.257174 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9abed2e1-2550-4dbc-b567-adf8754a3772 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 200 len: 1330 microversion: 2.1 time: 0.110127 Sep 09 15:00:38.257773 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 228/456] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:38 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:38.700881 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:38.701729 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:38.709140 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:38.709858 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:38.710290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:38.711249 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:38.711853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:38.712427 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:38.857165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:38.866138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d44253c7-18b6-48b1-bb14-dd89b293f6e5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1713 microversion: 2.1 time: 0.170094 Sep 09 15:00:38.866710 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 229/457] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:38 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:39.281302 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:39.281832 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:39.288188 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:39.288667 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:39.289109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:39.289803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:39.290252 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:39.290673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:39.303741 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 HTTP/1.1 Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:00:39.305388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:00:39.306897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '70c93a5b-944b-43a7-95f6-e49c229603b6'} Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:00:39.307767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:00:39.309238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:00:39.310650 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:00:39.310650 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83ecfcff-81f1-4b8e-9d4b-a81e1ccbc209 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 404 len: 111 microversion: 2.1 time: 0.030383 Sep 09 15:00:39.310650 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 229/458] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:39 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:00:39.315625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-10cc6bb9-9a80-46eb-a9f9-82c842d66ba2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '.version_select at 0x7f8ad280a820>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:39.334979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-10cc6bb9-9a80-46eb-a9f9-82c842d66ba2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-222111713" status: 202 len: 0 microversion: 2.1 time: 0.023336 Sep 09 15:00:39.335556 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 230/459] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Sep 9 15:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-222111713 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:00:39.943155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6680dca1-6ec4-4ac6-bad5-d8d54283b19e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: .version_select at 0x7f8ad2652790>, body: {"keypair": {"name": "tempest-keypair-677230621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFznAkNxjHIS6ChknGPMldsPw2ZoyC4TJtIXZHfUFEclGHdLCbnsS5wTq3va4Myu0XSKzPi5wndEqa9bKiOUKlNJ0oatseB/C+kpiT9Vfq4ogcMFoHWJ1+93kl0hVTMQQ=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:39.959146 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-6680dca1-6ec4-4ac6-bad5-d8d54283b19e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for project 063bdf7448ee45939287687b0e65dd97. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:00:39.962945 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-6680dca1-6ec4-4ac6-bad5-d8d54283b19e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for user 770105b06e084179a819a54d28b70cdf and project 063bdf7448ee45939287687b0e65dd97. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:00:39.984850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6680dca1-6ec4-4ac6-bad5-d8d54283b19e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045469 Sep 09 15:00:39.985469 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 230/460] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 15:00:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:00:41.250816 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-123875230", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ced1175-a542-4682-b032-b597d6969844"}], "security_groups": [{"name": "tempest-securitygroup--1297975387"}], "key_name": "tempest-keypair-677230621", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:41.372696 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] validate_networks() for [('2ced1175-a542-4682-b032-b597d6969844', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:00:41.759715 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:00:41.760249 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:00:41.760818 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:00:41.761342 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:00:41.761827 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:00:41.771574 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:41.772064 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:41.773301 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:41.774416 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:41.774875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:41.775306 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:41.793085 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for project 063bdf7448ee45939287687b0e65dd97. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:00:41.797041 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for user 770105b06e084179a819a54d28b70cdf and project 063bdf7448ee45939287687b0e65dd97. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:00:41.807857 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:00:41.810164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:00:41.857935 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0645fabc-6b83-45e0-8271-16381c5244cd tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.612173 Sep 09 15:00:41.858624 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 231/461] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:00:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 15:00:41.870913 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b9a4650-5b44-41b6-83d7-25591202e608 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:41.871521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b9a4650-5b44-41b6-83d7-25591202e608 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:41.935479 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b9a4650-5b44-41b6-83d7-25591202e608 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:41.942847 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b9a4650-5b44-41b6-83d7-25591202e608 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1240 microversion: 2.1 time: 0.076291 Sep 09 15:00:41.943408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 231/462] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:41 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:42.966413 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:42.967049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:42.972928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:42.973458 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:42.973894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:42.974577 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:42.975027 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:42.975444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:43.051952 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:43.061854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ef9be88c-d376-43e2-bbf4-f91b4d94d10c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1292 microversion: 2.1 time: 0.098978 Sep 09 15:00:43.062809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 232/463] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:42 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:44.085741 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:44.086440 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:44.095766 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:44.096455 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:44.097342 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:44.098065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:44.098573 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:44.099210 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:44.307177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:44.314765 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23bbed18-581f-4997-a09c-83152b22f286 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1366 microversion: 2.1 time: 0.232990 Sep 09 15:00:44.315330 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 232/464] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:44 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:44.785085 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-da0c9dd6-7bb9-47f6-af96-09796de6e670 req-e2f067e9-7556-4491-8f4e-16b80a236b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58941584-8b16-4d54-91ca-6565820ed69b", "tag": "a1c91661-7c07-4dc3-841f-ae251678bbd8"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:44.799741 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-da0c9dd6-7bb9-47f6-af96-09796de6e670 req-e2f067e9-7556-4491-8f4e-16b80a236b5c service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:44.800583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-da0c9dd6-7bb9-47f6-af96-09796de6e670 req-e2f067e9-7556-4491-8f4e-16b80a236b5c service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:44.801365 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-da0c9dd6-7bb9-47f6-af96-09796de6e670 req-e2f067e9-7556-4491-8f4e-16b80a236b5c service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:44.814282 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-da0c9dd6-7bb9-47f6-af96-09796de6e670 req-e2f067e9-7556-4491-8f4e-16b80a236b5c service nova] Creating event network-changed:a1c91661-7c07-4dc3-841f-ae251678bbd8 for instance 58941584-8b16-4d54-91ca-6565820ed69b on hv-cinder-82869 Sep 09 15:00:44.819918 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-da0c9dd6-7bb9-47f6-af96-09796de6e670 req-e2f067e9-7556-4491-8f4e-16b80a236b5c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038414 Sep 09 15:00:44.820786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 233/465] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:00:45.337406 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:45.338065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:45.344497 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:45.344982 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:45.345451 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:45.346142 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:45.346596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:45.347016 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:45.478371 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:45.487003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-021bbb28-186f-45ef-a4c1-29bb7b275c4d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1366 microversion: 2.1 time: 0.153663 Sep 09 15:00:45.487578 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 233/466] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:45 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:46.512067 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:46.513372 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:46.520445 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:46.520935 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:46.521407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:46.522113 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:46.522737 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:46.523320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:46.794677 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:46.802735 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-18ef1c3a-2b38-4700-9b71-4df52d4de86c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1366 microversion: 2.1 time: 0.295554 Sep 09 15:00:46.803309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 234/467] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:46 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:47.829786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:47.830404 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:47.834552 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:47.840053 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:47.840623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:47.841214 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:47.842989 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:47.843475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:47.844006 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:47.863837 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:48.006709 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:48.018940 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd356a00-d4b8-42d2-8d77-13057c24064a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1366 microversion: 2.1 time: 0.193463 Sep 09 15:00:48.019965 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 234/468] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:47 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:49.044145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:49.044695 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:49.051564 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:49.052042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:49.052476 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:49.053159 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:49.053635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:49.054083 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:49.183490 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:49.191695 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b6cb987b-2898-41cf-b660-523a15729c4f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1366 microversion: 2.1 time: 0.151418 Sep 09 15:00:49.192256 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 235/469] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:49 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:50.214240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:50.214971 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:50.221420 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:50.221897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:50.222328 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:50.223001 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:50.223445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:50.223862 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:50.351304 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:50.359305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-641a4c58-5a63-4058-b5fb-c340c3048e26 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1366 microversion: 2.1 time: 0.148893 Sep 09 15:00:50.359883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 235/470] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:50 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:51.381567 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:51.382186 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:51.388674 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:51.389156 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:51.389630 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:51.390356 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:51.390809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:51.391233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:51.430249 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-ba926fe3-d8e5-41eb-aecb-b27ed1e3ddd5 req-879fae57-9312-450b-89cb-dca6ae57058e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58941584-8b16-4d54-91ca-6565820ed69b", "name": "network-vif-plugged", "status": "completed", "tag": "a1c91661-7c07-4dc3-841f-ae251678bbd8"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:51.442508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ba926fe3-d8e5-41eb-aecb-b27ed1e3ddd5 req-879fae57-9312-450b-89cb-dca6ae57058e service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:51.443065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ba926fe3-d8e5-41eb-aecb-b27ed1e3ddd5 req-879fae57-9312-450b-89cb-dca6ae57058e service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:51.443560 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ba926fe3-d8e5-41eb-aecb-b27ed1e3ddd5 req-879fae57-9312-450b-89cb-dca6ae57058e service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:51.454780 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-ba926fe3-d8e5-41eb-aecb-b27ed1e3ddd5 req-879fae57-9312-450b-89cb-dca6ae57058e service nova] Creating event network-vif-plugged:a1c91661-7c07-4dc3-841f-ae251678bbd8 for instance 58941584-8b16-4d54-91ca-6565820ed69b on hv-cinder-82869 Sep 09 15:00:51.460119 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-ba926fe3-d8e5-41eb-aecb-b27ed1e3ddd5 req-879fae57-9312-450b-89cb-dca6ae57058e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034447 Sep 09 15:00:51.460789 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 236/471] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:00:51.534104 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:51.541916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d7402ee-d9b5-4d1e-8516-22040d805b78 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1366 microversion: 2.1 time: 0.164147 Sep 09 15:00:51.542479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 236/472] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:51 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:52.565910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:52.566663 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:52.570070 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:52.574958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:52.575441 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:52.575877 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:52.576598 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:52.577111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:52.578054 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:52.710006 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:52.718180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e136c1b-27f3-4ffc-8a22-4f62649bd271 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1366 microversion: 2.1 time: 0.156866 Sep 09 15:00:52.718849 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 237/473] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:52 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:00:53.743132 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:53.743750 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:53.745719 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:53.746378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:53.753062 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:53.753572 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:53.754016 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:53.754707 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:53.755160 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:53.755583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:53.885070 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:53.893340 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f0b26240-c8ae-4b38-93a2-3b3724ef9543 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1366 microversion: 2.1 time: 0.154574 Sep 09 15:00:53.893899 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 237/474] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:53 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:54.915650 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:54.916254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:54.923650 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:54.924143 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:54.924586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:54.925335 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:54.925797 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:54.926226 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:55.061381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:00:55.069478 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea136206-5e73-46ef-822c-02b0008ef144 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1556 microversion: 2.1 time: 0.157533 Sep 09 15:00:55.070052 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 238/475] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:00:54 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:00:55.091723 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d7bd7630-918e-430e-9917-5a24984305c0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:00:55.092229 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d7bd7630-918e-430e-9917-5a24984305c0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:00:55.099713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7bd7630-918e-430e-9917-5a24984305c0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:55.100237 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7bd7630-918e-430e-9917-5a24984305c0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:55.100701 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7bd7630-918e-430e-9917-5a24984305c0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:55.101416 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7bd7630-918e-430e-9917-5a24984305c0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:55.101884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7bd7630-918e-430e-9917-5a24984305c0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:55.102345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7bd7630-918e-430e-9917-5a24984305c0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:55.118297 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:55.188967 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d7bd7630-918e-430e-9917-5a24984305c0 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100990 Sep 09 15:00:55.189691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 238/476] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 15:00:55 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:00:56.194043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c462a77b-b040-49f8-b7a4-078cb90115bb req-dbe21e30-a601-4b0d-8dc3-590ea8d76846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58941584-8b16-4d54-91ca-6565820ed69b", "tag": "a1c91661-7c07-4dc3-841f-ae251678bbd8"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:00:56.204594 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c462a77b-b040-49f8-b7a4-078cb90115bb req-dbe21e30-a601-4b0d-8dc3-590ea8d76846 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:00:56.205079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c462a77b-b040-49f8-b7a4-078cb90115bb req-dbe21e30-a601-4b0d-8dc3-590ea8d76846 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:00:56.205536 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c462a77b-b040-49f8-b7a4-078cb90115bb req-dbe21e30-a601-4b0d-8dc3-590ea8d76846 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:00:56.216639 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c462a77b-b040-49f8-b7a4-078cb90115bb req-dbe21e30-a601-4b0d-8dc3-590ea8d76846 service nova] Creating event network-changed:a1c91661-7c07-4dc3-841f-ae251678bbd8 for instance 58941584-8b16-4d54-91ca-6565820ed69b on hv-cinder-82869 Sep 09 15:00:56.222025 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c462a77b-b040-49f8-b7a4-078cb90115bb req-dbe21e30-a601-4b0d-8dc3-590ea8d76846 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031549 Sep 09 15:00:56.222634 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 239/477] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:05.262498 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:05.263664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:05.430899 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f758dd43-9e08-4ae1-aa51-931d4d2924b5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Action: 'create', calling method: .version_select at 0x7f8ad2765a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-845692317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfOSC4t8eIJSb9da8zkVw0ZrdiVR8MAN59zF/3pzwFZoY8GzwTX85h8HqUZvD5qdnqTCIBcdvHqsFEt8oKq3tNep4Ptz0WFcL77sPBmYjayVD6MBAXvJDNNat1NbHXifw=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:05.446859 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-f758dd43-9e08-4ae1-aa51-931d4d2924b5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Getting quotas for project 515d1ca3dcd249ada56b21a0a6e3a5b9. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:01:05.451065 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-f758dd43-9e08-4ae1-aa51-931d4d2924b5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Getting quotas for user 9a50fbbf18584bb1a784283e768be7a2 and project 515d1ca3dcd249ada56b21a0a6e3a5b9. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:01:05.479873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f758dd43-9e08-4ae1-aa51-931d4d2924b5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.218835 Sep 09 15:01:05.480479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 239/478] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 15:01:05 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:10.584051 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=11 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:10.584845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=26 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:10.589397 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad6f296e-6827-486b-ae0a-49e8bbaf64f8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7c8c79f-df19-4cef-99fc-3dc14552871c"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:10.592131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad6f296e-6827-486b-ae0a-49e8bbaf64f8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:10.602032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6f296e-6827-486b-ae0a-49e8bbaf64f8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:10.602527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6f296e-6827-486b-ae0a-49e8bbaf64f8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:10.602966 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6f296e-6827-486b-ae0a-49e8bbaf64f8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:10.603679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6f296e-6827-486b-ae0a-49e8bbaf64f8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:10.604131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6f296e-6827-486b-ae0a-49e8bbaf64f8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:10.604585 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6f296e-6827-486b-ae0a-49e8bbaf64f8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:10.878027 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad6f296e-6827-486b-ae0a-49e8bbaf64f8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295686 Sep 09 15:01:10.878717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 240/479] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:01:10 2022] POST /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:13.795578 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-93997b98-b45a-4d74-88d5-f2e2ba593597 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:13.796095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-93997b98-b45a-4d74-88d5-f2e2ba593597 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:13.803837 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93997b98-b45a-4d74-88d5-f2e2ba593597 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:13.804325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93997b98-b45a-4d74-88d5-f2e2ba593597 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:13.804950 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93997b98-b45a-4d74-88d5-f2e2ba593597 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:13.805667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93997b98-b45a-4d74-88d5-f2e2ba593597 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:13.806242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93997b98-b45a-4d74-88d5-f2e2ba593597 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:13.806742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93997b98-b45a-4d74-88d5-f2e2ba593597 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:13.838727 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-93997b98-b45a-4d74-88d5-f2e2ba593597 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments/1baa5b7a-7661-4a6e-8d18-933c67f5dbc9" status: 200 len: 194 microversion: 2.20 time: 0.047086 Sep 09 15:01:13.839311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 240/480] 10.222.0.15 () {60 vars in 1454 bytes} [Fri Sep 9 15:01:13 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments/1baa5b7a-7661-4a6e-8d18-933c67f5dbc9 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 15:01:13.910517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:13.911096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:13.917688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:13.918180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:13.918617 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:13.919320 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:13.919774 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:13.920197 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:14.000731 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lazy-loading 'services' on Instance uuid af9e901f-c6b3-4840-ae33-2953c8e39eee {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:01:14.075181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0002f708-666a-4dc3-90c3-04665404238c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "DELETE /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments/1baa5b7a-7661-4a6e-8d18-933c67f5dbc9" status: 202 len: 0 microversion: 2.20 time: 0.169759 Sep 09 15:01:14.076044 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 241/481] 10.222.0.15 () {60 vars in 1457 bytes} [Fri Sep 9 15:01:13 2022] DELETE /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments/1baa5b7a-7661-4a6e-8d18-933c67f5dbc9 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:01:14.085208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-268f9c7a-ad14-4841-8e3f-f8d77c7fa477 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:14.087415 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-268f9c7a-ad14-4841-8e3f-f8d77c7fa477 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:14.093421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-268f9c7a-ad14-4841-8e3f-f8d77c7fa477 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:14.093758 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-268f9c7a-ad14-4841-8e3f-f8d77c7fa477 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:14.094193 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-268f9c7a-ad14-4841-8e3f-f8d77c7fa477 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:14.094893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-268f9c7a-ad14-4841-8e3f-f8d77c7fa477 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:14.095347 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-268f9c7a-ad14-4841-8e3f-f8d77c7fa477 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:14.095776 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-268f9c7a-ad14-4841-8e3f-f8d77c7fa477 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:14.126991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-268f9c7a-ad14-4841-8e3f-f8d77c7fa477 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045689 Sep 09 15:01:14.127548 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 241/482] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 15:01:14 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 15:01:15.140615 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-867aa37c-7498-4704-adff-542713e7aa2d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:15.142947 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-867aa37c-7498-4704-adff-542713e7aa2d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:15.149567 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-867aa37c-7498-4704-adff-542713e7aa2d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:15.150069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-867aa37c-7498-4704-adff-542713e7aa2d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:15.150491 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-867aa37c-7498-4704-adff-542713e7aa2d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:15.151182 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-867aa37c-7498-4704-adff-542713e7aa2d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:15.151637 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-867aa37c-7498-4704-adff-542713e7aa2d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:15.152059 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-867aa37c-7498-4704-adff-542713e7aa2d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:15.183016 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-867aa37c-7498-4704-adff-542713e7aa2d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046709 Sep 09 15:01:15.183576 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 242/483] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 15:01:15 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 15:01:16.195624 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-14cf91b2-28db-4b60-a978-c67958047798 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:16.197885 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-14cf91b2-28db-4b60-a978-c67958047798 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:16.200382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=4 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:16.208389 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14cf91b2-28db-4b60-a978-c67958047798 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:16.208893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14cf91b2-28db-4b60-a978-c67958047798 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:16.209382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14cf91b2-28db-4b60-a978-c67958047798 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:16.210103 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14cf91b2-28db-4b60-a978-c67958047798 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:16.210562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14cf91b2-28db-4b60-a978-c67958047798 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:16.210992 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14cf91b2-28db-4b60-a978-c67958047798 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:16.247927 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-14cf91b2-28db-4b60-a978-c67958047798 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056220 Sep 09 15:01:16.248551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 242/484] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 15:01:16 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 15:01:17.260920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ebaebfda-c9b0-495e-98f3-1b6c44d6032c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:17.263124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ebaebfda-c9b0-495e-98f3-1b6c44d6032c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:17.270076 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebaebfda-c9b0-495e-98f3-1b6c44d6032c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:17.270571 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebaebfda-c9b0-495e-98f3-1b6c44d6032c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:17.270997 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebaebfda-c9b0-495e-98f3-1b6c44d6032c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:17.271691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebaebfda-c9b0-495e-98f3-1b6c44d6032c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:17.272142 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebaebfda-c9b0-495e-98f3-1b6c44d6032c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:17.272575 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebaebfda-c9b0-495e-98f3-1b6c44d6032c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:17.305970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ebaebfda-c9b0-495e-98f3-1b6c44d6032c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047941 Sep 09 15:01:17.305970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 243/485] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 15:01:17 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 15:01:18.318061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9c33c31a-bde1-4ff1-9223-0cdc8c1ae725 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:18.320210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9c33c31a-bde1-4ff1-9223-0cdc8c1ae725 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:18.326311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c33c31a-bde1-4ff1-9223-0cdc8c1ae725 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:18.326802 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c33c31a-bde1-4ff1-9223-0cdc8c1ae725 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:18.327238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c33c31a-bde1-4ff1-9223-0cdc8c1ae725 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:18.327958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c33c31a-bde1-4ff1-9223-0cdc8c1ae725 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:18.328418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c33c31a-bde1-4ff1-9223-0cdc8c1ae725 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:18.328835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c33c31a-bde1-4ff1-9223-0cdc8c1ae725 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:18.361642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9c33c31a-bde1-4ff1-9223-0cdc8c1ae725 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047981 Sep 09 15:01:18.362194 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 243/486] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 15:01:18 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 15:01:18.446039 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:18.449947 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:18.459480 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:18.460136 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:18.460815 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:18.462041 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:18.462824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:18.464978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:18.507116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lazy-loading 'flavor' on Instance uuid aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:01:18.633962 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c7d3cd1-187e-4899-95d0-18c02f8af8fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/action" status: 200 len: 32 microversion: 2.1 time: 0.197715 Sep 09 15:01:18.634893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 244/487] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:01:18 2022] POST /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 15:01:18.644734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:18.645376 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:18.651330 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:18.651815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:18.652253 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:18.652950 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:18.653437 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:18.654120 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:18.783953 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:18.792191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d22acad-52d0-411c-ae78-a3dca8197c67 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.152002 Sep 09 15:01:18.792755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 244/488] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:18 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:19.374156 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2fd9784a-0f2c-430d-ba3f-763d2e688f34 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:19.376341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2fd9784a-0f2c-430d-ba3f-763d2e688f34 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:19.382719 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd9784a-0f2c-430d-ba3f-763d2e688f34 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:19.383207 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd9784a-0f2c-430d-ba3f-763d2e688f34 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:19.383646 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd9784a-0f2c-430d-ba3f-763d2e688f34 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:19.384342 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd9784a-0f2c-430d-ba3f-763d2e688f34 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:19.384795 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd9784a-0f2c-430d-ba3f-763d2e688f34 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:19.385249 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fd9784a-0f2c-430d-ba3f-763d2e688f34 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:19.414889 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2fd9784a-0f2c-430d-ba3f-763d2e688f34 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045053 Sep 09 15:01:19.415481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 245/489] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 15:01:19 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:19.478673 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:19.479177 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:19.486471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:19.487249 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:19.487941 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:19.488832 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:19.489313 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:19.489737 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:19.516948 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:01:19.601366 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b916611e-b303-4674-aca9-d93543fba7c1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "DELETE /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 204 len: 0 microversion: 2.20 time: 0.126170 Sep 09 15:01:19.602433 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 245/490] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Sep 9 15:01:19 2022] DELETE /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 15:01:19.619994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:19.620627 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:19.627826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:19.628316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:19.628789 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:19.629525 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:19.630352 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:19.631106 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:19.770107 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:19.778480 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:19.780175 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:19.781346 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-788b1616-5532-4edd-b50b-f8cec9660020 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.172529 Sep 09 15:01:19.781907 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 246/491] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:19 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:19.815472 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:19.816161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:19.822081 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:19.822564 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:19.822999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:19.823713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:19.824165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:19.824587 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:19.958442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:19.967360 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-22f7ea99-e96e-43a4-b042-f854430cae03 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.156231 Sep 09 15:01:19.967930 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 246/492] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:19 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:20.807149 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:20.807689 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:20.814276 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:20.814758 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:20.815195 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:20.815882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:20.816370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:20.816792 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:20.948047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:20.957112 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:20.958597 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:20.959744 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0a217ee1-c020-47f8-b8ab-f77122e39839 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.156650 Sep 09 15:01:20.960312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 247/493] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:20 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:20.991221 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:20.991831 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:20.998223 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:20.998704 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:20.999134 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:21.000187 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:21.000648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:21.001068 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:21.127060 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:21.135235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8239901c-b804-4eaa-b03d-bf4070651c4e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.147861 Sep 09 15:01:21.135798 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 247/494] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:20 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:21.986252 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:21.986903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:21.993784 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:21.994274 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:21.994719 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:21.995418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:21.995874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:21.996302 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:22.159378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:22.160090 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:22.166340 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:22.166831 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:22.167304 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:22.168014 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:22.168476 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:22.168905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:22.202063 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:22.215736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:22.217450 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:22.218623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93638448-d81c-4c1c-856c-10c3151c7bbe tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1724 microversion: 2.20 time: 0.236931 Sep 09 15:01:22.219188 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 248/495] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:21 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:22.622138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:22.630922 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3f34a68f-b9ad-4e25-a2c8-0a52c5baf502 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.475352 Sep 09 15:01:22.631887 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 248/496] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:22 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:22.788355 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-607ab3ee-9fb7-4692-9025-38eeffbd4fd5 req-9d6593db-e4db-4791-bb0a-0c883e2e0a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9e901f-c6b3-4840-ae33-2953c8e39eee", "name": "network-vif-deleted", "tag": "27073afa-d48f-4e5f-b5fb-94c6c6f9082c"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:22.803000 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-607ab3ee-9fb7-4692-9025-38eeffbd4fd5 req-9d6593db-e4db-4791-bb0a-0c883e2e0a0c service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:22.804091 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-607ab3ee-9fb7-4692-9025-38eeffbd4fd5 req-9d6593db-e4db-4791-bb0a-0c883e2e0a0c service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:22.804997 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-607ab3ee-9fb7-4692-9025-38eeffbd4fd5 req-9d6593db-e4db-4791-bb0a-0c883e2e0a0c service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:22.820809 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-607ab3ee-9fb7-4692-9025-38eeffbd4fd5 req-9d6593db-e4db-4791-bb0a-0c883e2e0a0c service nova] Creating event network-vif-deleted:27073afa-d48f-4e5f-b5fb-94c6c6f9082c for instance af9e901f-c6b3-4840-ae33-2953c8e39eee on hv-cinder-82869 Sep 09 15:01:22.827763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-607ab3ee-9fb7-4692-9025-38eeffbd4fd5 req-9d6593db-e4db-4791-bb0a-0c883e2e0a0c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042240 Sep 09 15:01:22.828157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-665256705", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-845692317", "security_groups": [{"name": "tempest-secgroup-smoke-796642502"}], "block_device_mapping_v2": [{"uuid": "92d92f58-232e-4084-a4ae-eeb476a7e005", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "20d1d01f-8d2e-4d86-913d-da4da3df92d5"}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:22.828660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 249/497] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:22.955111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] validate_networks() for [('20d1d01f-8d2e-4d86-913d-da4da3df92d5', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:01:23.244636 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:23.245371 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:23.252550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:23.253038 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:23.253495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:23.254366 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:23.254816 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:23.255394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:23.287373 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:23.287779 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:23.288222 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:23.288677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lazy-loading 'fault' on Instance uuid af9e901f-c6b3-4840-ae33-2953c8e39eee {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:01:23.348510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:23.356715 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:23.358281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:23.359803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd262ef4-e8c9-46c5-8ede-b42a4f4cd720 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 200 len: 1371 microversion: 2.20 time: 0.119211 Sep 09 15:01:23.360485 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 250/498] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:23 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 1371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:01:23.386644 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:01:23.387171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:01:23.387526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:01:23.387932 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:01:23.388340 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:01:23.398423 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:23.398905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:23.399492 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:23.400217 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:23.400670 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:23.401090 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:23.418945 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Getting quotas for project 515d1ca3dcd249ada56b21a0a6e3a5b9. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:01:23.423598 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Getting quotas for user 9a50fbbf18584bb1a784283e768be7a2 and project 515d1ca3dcd249ada56b21a0a6e3a5b9. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:01:23.485054 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:01:23.488457 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92d92f58-232e-4084-a4ae-eeb476a7e005',volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:01:23.636288 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-24f88ac3-ffc4-4121-9be5-59b6dfb75cc2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.812762 Sep 09 15:01:23.636937 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 249/499] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:01:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 15:01:23.649398 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64014b7c-4158-486d-9378-70969d6890d7 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:23.650378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64014b7c-4158-486d-9378-70969d6890d7 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:23.653623 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:23.654831 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:23.661825 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:23.662309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:23.662739 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:23.663595 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:23.664236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:23.664903 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:23.718574 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64014b7c-4158-486d-9378-70969d6890d7 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:23.728826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64014b7c-4158-486d-9378-70969d6890d7 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1093 microversion: 2.1 time: 0.084716 Sep 09 15:01:23.729758 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 251/500] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:23 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:23.831789 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:23.840966 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a254ddbe-811d-464a-9a34-0db54dfaa6fc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.191200 Sep 09 15:01:23.841634 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 250/501] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:23 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:24.386563 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:24.387251 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:24.394786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:24.395334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:24.395836 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:24.396593 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:24.397292 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:24.398037 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:24.412392 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] HTTP exception thrown: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Request method failure captured: Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee HTTP/1.1 Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RTBHu6wiAwS0eDu4gGT_Us-R7ND-j_uGygHncDftmQsFELDYTn0sP_fVJDtrxpBqTrduNRQE2a0FQg-pXpp5N_46MQZWP2trXY3JdvxS7wZl66IjhokZ7wbtVtdxJ6iV-RA6mu-jgF7uLx8sR95IjU3RVzKRzMFqEWKHhrtY9UKxQ Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:01:24.414224 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c83910e3ac2f4c8f9f127ab767bffd1a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 3c0c848f7858486c91773b34047d8aad Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:01:24.415937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': 'af9e901f-c6b3-4840-ae33-2953c8e39eee'} Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:01:24.416867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:01:24.418400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:24.419730 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Returning 404 to user: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:01:24.419730 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24b791b6-0d24-466c-b2c7-93c34d1f2acc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 404 len: 111 microversion: 2.20 time: 0.033466 Sep 09 15:01:24.419730 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 252/502] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:24 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 15:01:24.425045 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1bc98cbc-361a-4f48-8a9c-2a71f77c1a1c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '.version_select at 0x7f8ad2785f70>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:24.445146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1bc98cbc-361a-4f48-8a9c-2a71f77c1a1c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124470571" status: 204 len: 0 microversion: 2.20 time: 0.023832 Sep 09 15:01:24.445751 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 251/503] 10.222.0.15 () {60 vars in 1262 bytes} [Fri Sep 9 15:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124470571 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 09 15:01:24.754397 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:24.755235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:24.761743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:24.762308 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:24.762821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:24.763597 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:24.764058 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:24.764485 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:24.842968 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:24.852056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e5dad79-27f4-47c4-8ece-c809aa8f832b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1191 microversion: 2.1 time: 0.102022 Sep 09 15:01:24.852780 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 253/504] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:24 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1191 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:24.873519 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:24.874144 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:24.881837 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:24.882333 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:24.882778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:24.883489 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:24.884064 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:24.884494 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:25.147102 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:25.155817 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2333900b-3293-420c-af64-e4d0bafa83c1 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.295687 Sep 09 15:01:25.156705 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 252/505] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:24 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:25.328723 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35e2b0a2-93ee-498a-b5d9-1520f333359c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'create', calling method: .version_select at 0x7f8ad260b820>, body: {"keypair": {"name": "tempest-keypair-2053946964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Jtd431z9MgKmqQnmiduW1QnweyUeqtZkFj66ETw1Ipb0hLjIXCnWYPm6PhZ7v3BGdW/6MWaEt7QjXRZ1cdl6y9J/fxh06PmHCyUnqwbC1i5VQ4GNaeToO00fS75Ux5A=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:25.344323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-35e2b0a2-93ee-498a-b5d9-1520f333359c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Getting quotas for project c83910e3ac2f4c8f9f127ab767bffd1a. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:01:25.349328 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-35e2b0a2-93ee-498a-b5d9-1520f333359c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Getting quotas for user 3c0c848f7858486c91773b34047d8aad and project c83910e3ac2f4c8f9f127ab767bffd1a. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:01:25.377159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35e2b0a2-93ee-498a-b5d9-1520f333359c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052378 Sep 09 15:01:25.377899 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 254/506] 10.222.0.15 () {62 vars in 1200 bytes} [Fri Sep 9 15:01:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 15:01:25.875635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:25.876572 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:25.883927 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:25.884762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:25.885456 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:25.886564 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:25.887235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:25.888162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:26.150124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:26.158424 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7215da92-9c00-4150-a2ae-fba5871794da tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.286578 Sep 09 15:01:26.159284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 253/507] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:25 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:26.179568 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:26.180183 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:26.186093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:26.186554 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:26.186986 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:26.187677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:26.188318 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:26.189687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:26.212728 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:26.425663 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:26.434166 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1dd0a0c5-c2e5-4919-9051-a95bed7450d9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.258874 Sep 09 15:01:26.434900 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 255/508] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:26 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:26.623524 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-79c9565b-c3c3-44fd-bc68-c34e41c4258c req-0c58da38-dba8-47df-8d8c-5fb409d7c8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffad6426-5a0d-4119-9cd7-c60407cc7972", "tag": "8c96acd7-4922-4cce-9604-cfd8b94ada60"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:26.655354 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-79c9565b-c3c3-44fd-bc68-c34e41c4258c req-0c58da38-dba8-47df-8d8c-5fb409d7c8d3 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:26.655988 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-79c9565b-c3c3-44fd-bc68-c34e41c4258c req-0c58da38-dba8-47df-8d8c-5fb409d7c8d3 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:26.656512 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-79c9565b-c3c3-44fd-bc68-c34e41c4258c req-0c58da38-dba8-47df-8d8c-5fb409d7c8d3 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:26.671326 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-79c9565b-c3c3-44fd-bc68-c34e41c4258c req-0c58da38-dba8-47df-8d8c-5fb409d7c8d3 service nova] Creating event network-changed:8c96acd7-4922-4cce-9604-cfd8b94ada60 for instance ffad6426-5a0d-4119-9cd7-c60407cc7972 on hv-cinder-82869 Sep 09 15:01:26.679540 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-79c9565b-c3c3-44fd-bc68-c34e41c4258c req-0c58da38-dba8-47df-8d8c-5fb409d7c8d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065973 Sep 09 15:01:26.680974 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 254/509] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:26.738988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-186974100", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d5556e-7098-41ee-955a-f1126257e985"}], "security_groups": [{"name": "tempest-securitygroup--1957249756"}], "key_name": "tempest-keypair-2053946964", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:26.866032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] validate_networks() for [('93d5556e-7098-41ee-955a-f1126257e985', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:01:26.996710 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:26.997401 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:27.003609 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:27.004097 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:27.004534 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:27.005250 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:27.005712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:27.006139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:27.130926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lazy-loading 'services' on Instance uuid 762529ff-2c14-4d96-85cb-3908b1f9e26b {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:01:27.251074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6d23aa31-1abe-43cd-90b3-8340413eead8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/os-volume_attachments/f2e3d786-a82a-451a-a713-37ab4f54efef" status: 202 len: 0 microversion: 2.1 time: 0.258724 Sep 09 15:01:27.251701 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 255/510] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:01:26 2022] DELETE /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/os-volume_attachments/f2e3d786-a82a-451a-a713-37ab4f54efef => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 15:01:27.257409 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:27.258325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:27.267917 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:27.268415 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:27.268885 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:27.270026 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:27.270650 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:27.271074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:27.293143 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:27.483747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:01:27.484501 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:01:27.484897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:01:27.485376 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:01:27.485822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:01:27.487435 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:27.494665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:27.495148 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:27.495280 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-39afaff4-0790-437e-9189-a9387e347801 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.242200 Sep 09 15:01:27.495580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:27.495981 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 256/511] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:27 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:27.496311 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:27.496776 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:27.497335 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:27.500642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:27.501368 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:27.506997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:27.507559 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:27.508059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:27.508808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:27.509375 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:27.509863 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:27.516979 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Getting quotas for project c83910e3ac2f4c8f9f127ab767bffd1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:01:27.521956 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Getting quotas for user 3c0c848f7858486c91773b34047d8aad and project c83910e3ac2f4c8f9f127ab767bffd1a. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:01:27.534803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:01:27.537408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:01:27.588657 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1f06a98-b4d3-4752-aacc-5afe8cfdae7b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.854466 Sep 09 15:01:27.589908 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 256/512] 10.222.0.15 () {62 vars in 1188 bytes} [Fri Sep 9 15:01:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 15:01:27.600793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f4ada64-01e7-43c1-9c5b-bb629d2412b8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:27.602229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f4ada64-01e7-43c1-9c5b-bb629d2412b8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:27.671682 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f4ada64-01e7-43c1-9c5b-bb629d2412b8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:27.679974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f4ada64-01e7-43c1-9c5b-bb629d2412b8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:27.682184 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f4ada64-01e7-43c1-9c5b-bb629d2412b8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:27.683731 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f4ada64-01e7-43c1-9c5b-bb629d2412b8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1281 microversion: 2.20 time: 0.086717 Sep 09 15:01:27.684286 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 257/513] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:27 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:01:27.705139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:27.713377 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d4fbadde-56a7-410d-8c99-1fd587521160 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.216260 Sep 09 15:01:27.713949 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 257/514] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:27 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:28.413090 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34aec10a-cb71-42f1-8c09-8f12a9d71cb4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:28.419629 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34aec10a-cb71-42f1-8c09-8f12a9d71cb4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:28.420116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34aec10a-cb71-42f1-8c09-8f12a9d71cb4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:28.420549 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34aec10a-cb71-42f1-8c09-8f12a9d71cb4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:28.443252 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-34aec10a-cb71-42f1-8c09-8f12a9d71cb4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Going to try to stop instance {{(pid=120643) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 15:01:28.484179 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-34aec10a-cb71-42f1-8c09-8f12a9d71cb4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/action" status: 202 len: 0 microversion: 2.1 time: 0.074750 Sep 09 15:01:28.484923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 258/515] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:01:28 2022] POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:01:28.493626 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:28.494183 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:28.500497 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:28.501021 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:28.501506 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:28.502211 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:28.502654 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:28.503078 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:28.519031 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:28.519732 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:28.525822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:28.526308 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:28.526746 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:28.527442 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:28.527895 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:28.528331 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:28.975931 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:28.981390 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:28.983701 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-91abfa12-212b-4f79-b32d-77876e0482f8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1677 microversion: 2.1 time: 0.494139 Sep 09 15:01:28.984573 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 258/516] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:28 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1677 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:28.989419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:28.990020 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:28.998978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-107ea2b4-4554-48e3-bd5f-25a1130493ad tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.484101 Sep 09 15:01:28.999974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 259/517] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:28 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:29.001777 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:29.002650 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:29.003432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:29.004404 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:29.005107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:29.005872 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:29.006339 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:29.007064 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:29.013128 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:29.013917 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:29.014592 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:29.015507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:29.016868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:29.017536 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:29.129830 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:29.138248 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:29.139684 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:29.140778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8da82c1a-2b74-4be0-b1b9-c59b771cf56c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1351 microversion: 2.20 time: 0.155513 Sep 09 15:01:29.141359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 259/518] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:28 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:29.263045 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:29.271123 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e966b923-7ec9-49a2-9609-ef8ed7fda30c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.270031 Sep 09 15:01:29.271692 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 260/519] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:29 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:30.007898 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:30.008412 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:30.015092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:30.016007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:30.016579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:30.017770 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:30.018232 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:30.019820 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:30.024879 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:30.025526 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:30.032971 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:30.033482 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:30.034147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:30.034849 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:30.035299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:30.035717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:30.346660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:30.352836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:30.354642 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ec7322a-35c2-4a6c-99ac-e91676eabd99 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.333503 Sep 09 15:01:30.355294 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 261/520] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:30 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:30.359878 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:30.361018 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:30.366773 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:30.367251 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:30.367678 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:30.368527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:30.368978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:30.369434 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:30.377353 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a3ecc28a-b910-4c65-9a55-ca36e60d1683 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1677 microversion: 2.1 time: 0.373193 Sep 09 15:01:30.378099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 260/521] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:30 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1677 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:30.394506 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:30.395213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:30.401240 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:30.401799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:30.402435 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:30.403233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:30.404056 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:30.404546 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:30.617867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:30.626872 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:30.628359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:30.629645 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2274484-74d9-4dd1-a7c4-466c413ac5cc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1407 microversion: 2.20 time: 0.273117 Sep 09 15:01:30.630199 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 262/522] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:30 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:30.639993 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-999cde97-e098-47b5-890e-2217d647c730 req-05160da2-0dbc-4507-a659-42641871689a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ac907a-c540-41ce-bcc5-3339348a221b", "tag": "c8f3dda8-23ee-414a-9861-fbe66c356bcf"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:30.649589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-999cde97-e098-47b5-890e-2217d647c730 req-05160da2-0dbc-4507-a659-42641871689a service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:30.650068 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-999cde97-e098-47b5-890e-2217d647c730 req-05160da2-0dbc-4507-a659-42641871689a service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:30.650501 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-999cde97-e098-47b5-890e-2217d647c730 req-05160da2-0dbc-4507-a659-42641871689a service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:30.670630 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-999cde97-e098-47b5-890e-2217d647c730 req-05160da2-0dbc-4507-a659-42641871689a service nova] Creating event network-changed:c8f3dda8-23ee-414a-9861-fbe66c356bcf for instance 23ac907a-c540-41ce-bcc5-3339348a221b on hv-cinder-82869 Sep 09 15:01:30.676062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-999cde97-e098-47b5-890e-2217d647c730 req-05160da2-0dbc-4507-a659-42641871689a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039494 Sep 09 15:01:30.676823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 263/523] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:30.677518 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:30.685728 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e0a9a95a-8edf-4499-8f6a-f7b8bb8b3ccd tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.297991 Sep 09 15:01:30.686290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 261/524] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:30 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:31.379497 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:31.380188 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:31.386308 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:31.386794 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:31.387229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:31.387921 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:31.388412 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:31.388833 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:31.399672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:31.400286 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:31.406941 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:31.407451 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:31.407884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:31.408571 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:31.409018 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:31.409461 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:31.586344 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:31.594171 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-415b7331-d9e5-451a-919a-11d1f50bfddb tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.219843 Sep 09 15:01:31.594750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 264/525] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:31 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:31.597875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:31.605623 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e6fc8eb7-2203-4fa4-b1cd-ce51a32af1a6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1677 microversion: 2.1 time: 0.209751 Sep 09 15:01:31.606192 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 262/526] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:31 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:31.656506 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:31.657060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:31.663331 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:31.663816 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:31.664248 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:31.664936 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:31.665426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:31.665845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:31.709874 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:31.710481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:31.716318 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:31.716805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:31.717264 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:31.718039 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:31.718497 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:31.718920 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:31.850722 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:31.859014 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:31.860941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:31.862059 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b86a266c-5e1a-403a-9aff-ff2873839201 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1407 microversion: 2.20 time: 0.209969 Sep 09 15:01:31.862615 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 265/527] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:31 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:31.877094 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:31.885261 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4b0ef5e9-ebba-416a-98f4-52518dd58f72 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.179260 Sep 09 15:01:31.885820 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 263/528] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:31 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:32.616467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:32.617082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:32.623451 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:32.623933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:32.624368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:32.625074 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:32.625568 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:32.625988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:32.632906 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:32.633690 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:32.640087 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:32.640571 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:32.641004 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:32.642220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:32.642676 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:32.643094 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:32.831431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:32.836770 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:32.839149 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-794d7d44-8b2f-4658-ab81-b438cad410ed tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.226739 Sep 09 15:01:32.839728 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 266/529] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:32 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:32.844759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2c2a3383-7da1-490e-8859-0c68fca8e0a7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1677 microversion: 2.1 time: 0.215694 Sep 09 15:01:32.845816 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 264/530] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:32 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:32.887361 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:32.887970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:32.894485 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:32.894969 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:32.895405 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:32.896112 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:32.896559 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:32.896979 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:32.908029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:32.908646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:32.914596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:32.915090 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:32.915531 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:32.916236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:32.916699 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:32.917121 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:33.097833 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:33.101485 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:33.106249 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:33.107813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:33.108986 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25812daf-f76e-4155-a9ed-a41363413869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1407 microversion: 2.20 time: 0.225495 Sep 09 15:01:33.109881 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 267/531] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:32 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:33.110012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca264f91-05a8-4383-a4cd-b3c7be899693 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.205769 Sep 09 15:01:33.110545 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 265/532] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:32 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:33.862005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:33.862712 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:33.867415 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:33.868040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:33.869123 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:33.869643 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:33.869905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:33.870073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:33.870715 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:33.870878 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:33.871202 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:33.871623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:33.877680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:33.878175 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:33.878618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:33.879321 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:33.879779 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:33.880210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:34.174680 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:34.182440 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61ef3a41-a842-4919-a404-45847d77c7ea tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.324224 Sep 09 15:01:34.183285 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 268/533] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:33 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:34.185597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:34.189976 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:34.190593 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:34.194708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-34d2bd1f-2f11-4aa6-a4af-71f121e95c4f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1677 microversion: 2.1 time: 0.331035 Sep 09 15:01:34.195450 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 266/534] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:33 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1677 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:34.196856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:34.197383 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:34.197826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:34.198527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:34.198984 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:34.199412 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:34.208811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:34.209677 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:34.215733 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:34.216214 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:34.216805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:34.217542 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:34.218079 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:34.218505 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:34.494349 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:34.498141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:34.513907 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f36feaf6-4710-4157-8a78-a3db8159ab14 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.328098 Sep 09 15:01:34.514503 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 269/535] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:34 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:34.514661 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:34.516461 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:34.517624 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7169939f-06d0-4670-85fc-f77304b89ba4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1407 microversion: 2.20 time: 0.312677 Sep 09 15:01:34.518175 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 267/536] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:34 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:34.723765 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-9631c3b9-b9c4-47fa-8807-d3e1b0784025 req-b63c72bd-2fe2-4aea-8ca2-3bee402dbaae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ac907a-c540-41ce-bcc5-3339348a221b", "name": "network-vif-plugged", "status": "completed", "tag": "c8f3dda8-23ee-414a-9861-fbe66c356bcf"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:34.734043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-9631c3b9-b9c4-47fa-8807-d3e1b0784025 req-b63c72bd-2fe2-4aea-8ca2-3bee402dbaae service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:34.734645 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-9631c3b9-b9c4-47fa-8807-d3e1b0784025 req-b63c72bd-2fe2-4aea-8ca2-3bee402dbaae service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:34.735521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-9631c3b9-b9c4-47fa-8807-d3e1b0784025 req-b63c72bd-2fe2-4aea-8ca2-3bee402dbaae service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:34.749895 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-9631c3b9-b9c4-47fa-8807-d3e1b0784025 req-b63c72bd-2fe2-4aea-8ca2-3bee402dbaae service nova] Creating event network-vif-plugged:c8f3dda8-23ee-414a-9861-fbe66c356bcf for instance 23ac907a-c540-41ce-bcc5-3339348a221b on hv-cinder-82869 Sep 09 15:01:34.756959 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-9631c3b9-b9c4-47fa-8807-d3e1b0784025 req-b63c72bd-2fe2-4aea-8ca2-3bee402dbaae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037851 Sep 09 15:01:34.757988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 270/537] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:35.205976 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:35.206583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:35.213340 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:35.213924 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:35.214471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:35.215180 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:35.215631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:35.216241 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:35.218222 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:35.220000 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:35.227958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:35.229431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:35.230094 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:35.231223 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:35.231703 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:35.232437 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:35.442282 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:35.451682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e5335d98-9600-4c18-a478-a30e8c85abd5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.249312 Sep 09 15:01:35.452800 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 268/538] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:35 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:35.456463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:35.464710 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8b6557e-52bb-4a51-9105-11d77fb5e1b3 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1677 microversion: 2.1 time: 0.250660 Sep 09 15:01:35.465291 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 271/539] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:35 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:35.538438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:35.539048 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:35.540855 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:35.546127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:35.546611 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:35.547053 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:35.547751 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:35.548212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:35.548639 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:35.554317 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:35.554960 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:35.560823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:35.561407 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:35.561845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:35.562534 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:35.562985 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:35.563405 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:35.749362 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:35.756122 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:35.757857 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f50140e-3ead-4050-b136-9e903ea7b9b0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1735 microversion: 2.1 time: 0.223179 Sep 09 15:01:35.758443 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 269/540] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:35 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:35.764486 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:35.765973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:35.767575 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7c60b99-7f05-46f3-9615-665c4f278416 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1407 microversion: 2.20 time: 0.217224 Sep 09 15:01:35.768220 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 272/541] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:35 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:36.475029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:36.475669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:36.482069 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:36.482560 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:36.483001 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:36.483696 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:36.484210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:36.484582 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:36.488963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:36.489604 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:36.493272 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:36.497733 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:36.498439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:36.498877 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:36.499576 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:36.500056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:36.500477 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:36.700550 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:36.705802 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:36.709700 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ffd868be-f6ce-4261-9eef-cf7498ac9f25 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.238463 Sep 09 15:01:36.710306 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 270/542] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:36 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:36.717859 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76a50b85-0ae0-4511-ae47-417e35c02b1d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1677 microversion: 2.1 time: 0.233786 Sep 09 15:01:36.718439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 273/543] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:36 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:36.781663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:36.782482 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-bbb6909a-22ce-4169-b20b-70bfa22248c5 req-daa8b894-1ade-4971-a815-7ffdac282ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffad6426-5a0d-4119-9cd7-c60407cc7972", "name": "network-vif-plugged", "status": "completed", "tag": "8c96acd7-4922-4cce-9604-cfd8b94ada60"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:36.782903 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:36.788985 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:36.789531 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:36.789968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:36.790665 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:36.791120 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:36.791544 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:36.791951 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-bbb6909a-22ce-4169-b20b-70bfa22248c5 req-daa8b894-1ade-4971-a815-7ffdac282ee8 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:36.792424 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-bbb6909a-22ce-4169-b20b-70bfa22248c5 req-daa8b894-1ade-4971-a815-7ffdac282ee8 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:36.792851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-bbb6909a-22ce-4169-b20b-70bfa22248c5 req-daa8b894-1ade-4971-a815-7ffdac282ee8 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:36.796705 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:36.804937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-bbb6909a-22ce-4169-b20b-70bfa22248c5 req-daa8b894-1ade-4971-a815-7ffdac282ee8 service nova] Creating event network-vif-plugged:8c96acd7-4922-4cce-9604-cfd8b94ada60 for instance ffad6426-5a0d-4119-9cd7-c60407cc7972 on hv-cinder-82869 Sep 09 15:01:36.809893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-bbb6909a-22ce-4169-b20b-70bfa22248c5 req-daa8b894-1ade-4971-a815-7ffdac282ee8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031696 Sep 09 15:01:36.810586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 274/544] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:01:36.815557 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:36.816240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:36.822959 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:36.823394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:36.823859 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:36.824517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:36.824967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:36.825428 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.005978 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:37.007918 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:37.017153 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:37.018624 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:37.019731 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74407932-6953-4fa5-8abd-9d9545e1551e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1407 microversion: 2.20 time: 0.208031 Sep 09 15:01:37.020497 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 275/545] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:36 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:37.025053 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-da81c5ff-28d4-4d2d-8066-8d45e6e10f31 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1715 microversion: 2.1 time: 0.247402 Sep 09 15:01:37.025683 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 271/546] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:36 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1715 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:37.112796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9decc4bb-ee1d-4155-8a2e-5988a6ec3ddc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:37.113324 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9decc4bb-ee1d-4155-8a2e-5988a6ec3ddc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:37.119229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9decc4bb-ee1d-4155-8a2e-5988a6ec3ddc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.119707 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9decc4bb-ee1d-4155-8a2e-5988a6ec3ddc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.120141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9decc4bb-ee1d-4155-8a2e-5988a6ec3ddc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.120833 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9decc4bb-ee1d-4155-8a2e-5988a6ec3ddc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.121310 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9decc4bb-ee1d-4155-8a2e-5988a6ec3ddc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.121730 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9decc4bb-ee1d-4155-8a2e-5988a6ec3ddc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.135240 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:37.135732 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:37.142149 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.142628 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.143061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.143746 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.144196 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.144617 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.146349 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9decc4bb-ee1d-4155-8a2e-5988a6ec3ddc tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037389 Sep 09 15:01:37.146981 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 276/547] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 15:01:37 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:37.228903 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] HTTP exception thrown: Cannot 'detach_volume' instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 while it is in vm_state rescued Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Request method failure captured: Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: DELETE /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments/a7c8c79f-df19-4cef-99fc-3dc14552871c HTTP/1.1 Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RR0jZmzYl6UcfRkFayyMlevi0Iywujzul1Umo2IJj8q3R3lNGGST6iKANfvVW7rK8VRcV6ayKXynC7q16_zsSpfiOcWY5Slgmp6Lg9c49wKS-gTk5TuP8_XXNmBJqyxP7u__YCnrB3K2TOU22wbicKV1v5-TlXeMuJ9zAizqRmqT0 Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:01:37.230579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8051535f56a4e17a0fa1eeab7c08ce7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: cd6c40dd492e40599324ef05011895f3 Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:01:37.232096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Cannot 'detach_volume' instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 while it is in vm_state rescued Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'server_id': 'aaf7d1b4-008f-427e-afeb-a09b91f9c1a6', 'id': 'a7c8c79f-df19-4cef-99fc-3dc14552871c'} Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:01:37.232851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 while it is in vm_state rescued Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 while it is in vm_state rescued Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:37.234329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Returning 409 to user: Cannot 'detach_volume' instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 while it is in vm_state rescued {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:01:37.235525 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e19adaa0-2be1-4ee0-ad9c-8a9c47e6d77d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments/a7c8c79f-df19-4cef-99fc-3dc14552871c" status: 409 len: 152 microversion: 2.1 time: 0.100805 Sep 09 15:01:37.235525 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 272/548] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:01:37 2022] DELETE /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments/a7c8c79f-df19-4cef-99fc-3dc14552871c => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 09 15:01:37.240909 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30c55314-8852-483a-87e4-4c6dd4ef9d0a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:37.241474 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30c55314-8852-483a-87e4-4c6dd4ef9d0a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:37.247251 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30c55314-8852-483a-87e4-4c6dd4ef9d0a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.247734 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30c55314-8852-483a-87e4-4c6dd4ef9d0a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.248162 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30c55314-8852-483a-87e4-4c6dd4ef9d0a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.248846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30c55314-8852-483a-87e4-4c6dd4ef9d0a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.249328 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30c55314-8852-483a-87e4-4c6dd4ef9d0a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.249751 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30c55314-8852-483a-87e4-4c6dd4ef9d0a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.320494 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30c55314-8852-483a-87e4-4c6dd4ef9d0a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "POST /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/action" status: 202 len: 0 microversion: 2.1 time: 0.082911 Sep 09 15:01:37.322112 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 277/549] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:01:37 2022] POST /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:01:37.330901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:37.331649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:37.337508 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.337997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.338434 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.339135 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.339589 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.340084 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.344063 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:37.511889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:37.520646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-feca4c71-fce2-4076-861d-0b8e9014a25f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1723 microversion: 2.1 time: 0.194243 Sep 09 15:01:37.521223 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 273/550] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:37 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:37.734018 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:37.734728 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:37.741282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:37.742372 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=14 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:37.743402 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:37.744222 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:37.746122 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.746876 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.747801 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.748899 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.749646 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.750309 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.751359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.751849 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.752476 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.753270 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:37.753732 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:37.754364 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:37.984086 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:37.989879 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:37.992667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e528cb5f-570e-4705-8b2d-8cc0463809a1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1677 microversion: 2.1 time: 0.254105 Sep 09 15:01:37.993715 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 274/551] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:37 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:37.998342 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d4d47e8-ac8b-470f-a036-6ad56b0bcc54 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.268486 Sep 09 15:01:37.998912 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 278/552] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:37 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:38.044925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:38.045562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:38.051943 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:38.052427 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:38.052861 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:38.053573 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:38.054024 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:38.054449 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:38.205900 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:38.213955 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:38.215382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:38.216518 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dad78933-b8b2-4bd5-88e0-41704e68ff33 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1599 microversion: 2.20 time: 0.175464 Sep 09 15:01:38.217076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 275/553] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:01:38 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:01:38.241279 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7788ae1f-8571-419b-a32f-8ba5637fe1ef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:38.241771 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7788ae1f-8571-419b-a32f-8ba5637fe1ef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:38.247636 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7788ae1f-8571-419b-a32f-8ba5637fe1ef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:38.248110 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7788ae1f-8571-419b-a32f-8ba5637fe1ef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:38.248540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7788ae1f-8571-419b-a32f-8ba5637fe1ef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:38.249302 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7788ae1f-8571-419b-a32f-8ba5637fe1ef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:38.249758 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7788ae1f-8571-419b-a32f-8ba5637fe1ef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:38.250178 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7788ae1f-8571-419b-a32f-8ba5637fe1ef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:38.325085 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7788ae1f-8571-419b-a32f-8ba5637fe1ef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087603 Sep 09 15:01:38.325708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 279/554] 10.222.0.15 () {60 vars in 1316 bytes} [Fri Sep 9 15:01:38 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 15:01:38.490191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-aac215d7-6059-4804-8e2a-7690b8e5600d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89fb82b3-5509-4f63-a35a-5fdfd5b93b2c"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:38.492722 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-aac215d7-6059-4804-8e2a-7690b8e5600d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:38.499130 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aac215d7-6059-4804-8e2a-7690b8e5600d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:38.499621 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aac215d7-6059-4804-8e2a-7690b8e5600d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:38.500061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aac215d7-6059-4804-8e2a-7690b8e5600d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:38.500762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aac215d7-6059-4804-8e2a-7690b8e5600d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:38.501240 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aac215d7-6059-4804-8e2a-7690b8e5600d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:38.501676 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aac215d7-6059-4804-8e2a-7690b8e5600d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:38.543968 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:38.544576 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:38.550731 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:38.551299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:38.551828 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:38.552619 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:38.553142 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:38.553774 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:38.793319 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-aac215d7-6059-4804-8e2a-7690b8e5600d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307759 Sep 09 15:01:38.794115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 276/555] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:01:38 2022] POST /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:38.898322 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:38.907891 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35cb41bf-01dc-450f-9b4d-a1e609b37b2a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1723 microversion: 2.1 time: 0.367647 Sep 09 15:01:38.908464 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 280/556] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:38 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:39.020422 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:39.021425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:39.024049 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:39.024658 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:39.028228 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:39.029141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:39.029792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:39.030509 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:39.030969 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:39.031398 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:39.031511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:39.031932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:39.032370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:39.033061 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:39.033689 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:39.034274 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:39.560740 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:39.570554 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65ac780b-3b59-4ad9-bce8-8b0735476cdf tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1264 microversion: 2.1 time: 0.550062 Sep 09 15:01:39.571162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:39.571340 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 281/557] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:39 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1264 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:39.579905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-50845f12-76e8-4378-97c1-fc3afbbcfc6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1677 microversion: 2.1 time: 0.566559 Sep 09 15:01:39.581141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 277/558] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:39 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1677 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:39.874565 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-e30213a5-f9a5-43d6-abc8-6820fd66e3d9 req-9f628720-9e91-4992-b941-7e7df2104b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ac907a-c540-41ce-bcc5-3339348a221b", "tag": "c8f3dda8-23ee-414a-9861-fbe66c356bcf"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:39.884712 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e30213a5-f9a5-43d6-abc8-6820fd66e3d9 req-9f628720-9e91-4992-b941-7e7df2104b3b service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:39.885220 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e30213a5-f9a5-43d6-abc8-6820fd66e3d9 req-9f628720-9e91-4992-b941-7e7df2104b3b service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:39.885674 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e30213a5-f9a5-43d6-abc8-6820fd66e3d9 req-9f628720-9e91-4992-b941-7e7df2104b3b service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:39.897991 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-e30213a5-f9a5-43d6-abc8-6820fd66e3d9 req-9f628720-9e91-4992-b941-7e7df2104b3b service nova] Creating event network-changed:c8f3dda8-23ee-414a-9861-fbe66c356bcf for instance 23ac907a-c540-41ce-bcc5-3339348a221b on hv-cinder-82869 Sep 09 15:01:39.903216 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-e30213a5-f9a5-43d6-abc8-6820fd66e3d9 req-9f628720-9e91-4992-b941-7e7df2104b3b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032195 Sep 09 15:01:39.904373 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 282/559] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:39.944207 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:39.944870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:39.951292 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:39.951775 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:39.952210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:39.952905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:39.953377 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:39.954310 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.086129 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:40.094199 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-df598c5d-fe78-4c5c-bfc9-3c90bafe7cdb tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1723 microversion: 2.1 time: 0.155875 Sep 09 15:01:40.095438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 278/560] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:39 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:40.594173 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:40.594776 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:40.601160 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:40.601686 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:40.602124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.602828 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:40.603369 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:40.603811 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.604056 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:40.604847 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:40.611160 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:40.611588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:40.612364 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.613267 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:40.613725 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:40.614146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.799708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:40.808686 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b92ccea8-1a58-4499-a90b-05902e901ec8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1451 microversion: 2.1 time: 0.218534 Sep 09 15:01:40.812945 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 283/561] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:40 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1451 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:40.814780 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:40.822836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5581f94a-6372-4b3b-8adf-f3e0974986fa tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1654 microversion: 2.1 time: 0.222918 Sep 09 15:01:40.823591 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 279/562] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:40 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1654 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:40.832738 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:40.833406 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:40.839555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:40.840063 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:40.840782 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.841350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:40.841806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:40.842226 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.846807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-21bf727c-4c22-4b39-9db7-c44d95362688 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:40.853115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21bf727c-4c22-4b39-9db7-c44d95362688 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:40.853674 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21bf727c-4c22-4b39-9db7-c44d95362688 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:40.854109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21bf727c-4c22-4b39-9db7-c44d95362688 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.878487 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-21bf727c-4c22-4b39-9db7-c44d95362688 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Going to try to start instance {{(pid=120642) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 15:01:40.935969 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-21bf727c-4c22-4b39-9db7-c44d95362688 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/action" status: 202 len: 0 microversion: 2.1 time: 0.093250 Sep 09 15:01:40.936808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 280/563] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:01:40 2022] POST /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:01:40.946021 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:40.946822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:40.954365 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:40.955236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:40.955562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.956413 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:40.957095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:40.957643 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:40.992290 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:41.001987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-176ab230-3efe-4f6e-9777-0a205e7021ae tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1451 microversion: 2.1 time: 0.172985 Sep 09 15:01:41.005657 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 284/564] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:40 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:41.117506 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:41.118389 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:41.125135 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:41.126015 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:41.126673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:41.127869 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:41.128696 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:41.129394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:41.149774 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:41.158637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ff0fad7-5f42-48a6-a385-5dc097a340ad tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1663 microversion: 2.1 time: 0.217098 Sep 09 15:01:41.161873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 281/565] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:40 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1663 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:41.406410 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:41.414883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91c805ad-01bf-4877-81d5-9592f3cf94ae tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1723 microversion: 2.1 time: 0.301423 Sep 09 15:01:41.415454 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 285/566] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:41 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:42.185894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:42.186673 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:42.193244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:42.193950 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:42.194553 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:42.195247 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:42.195854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:42.196456 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:42.439350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:42.440152 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:42.447047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:42.447843 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:42.448411 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:42.449390 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:42.449950 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:42.450705 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:42.515782 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:42.525182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d8a93bd6-edbe-4196-90d5-85430f39da61 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1663 microversion: 2.1 time: 0.343162 Sep 09 15:01:42.526040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 282/567] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:42 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1663 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:42.686756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:42.698097 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c6634c6-fcb0-43b3-a246-39d278d5c0d6 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1729 microversion: 2.1 time: 0.262613 Sep 09 15:01:42.698603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 286/568] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:42 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1729 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:42.721572 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-874cf440-2241-43cc-9ade-1fb5eb9401c8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:42.722100 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-874cf440-2241-43cc-9ade-1fb5eb9401c8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:42.728136 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-874cf440-2241-43cc-9ade-1fb5eb9401c8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:42.728627 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-874cf440-2241-43cc-9ade-1fb5eb9401c8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:42.729067 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-874cf440-2241-43cc-9ade-1fb5eb9401c8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:42.729868 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-874cf440-2241-43cc-9ade-1fb5eb9401c8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:42.730325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-874cf440-2241-43cc-9ade-1fb5eb9401c8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:42.730755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-874cf440-2241-43cc-9ade-1fb5eb9401c8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:42.817072 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-874cf440-2241-43cc-9ade-1fb5eb9401c8 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099408 Sep 09 15:01:42.818006 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 283/569] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 15:01:42 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:42.819177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4e2236fb-f9c2-4f6d-a9cd-0503b65c6acb req-7ecd65b0-5b33-4386-b801-f4c0585711ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffad6426-5a0d-4119-9cd7-c60407cc7972", "tag": "8c96acd7-4922-4cce-9604-cfd8b94ada60"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:42.829927 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e2236fb-f9c2-4f6d-a9cd-0503b65c6acb req-7ecd65b0-5b33-4386-b801-f4c0585711ef service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:42.830410 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e2236fb-f9c2-4f6d-a9cd-0503b65c6acb req-7ecd65b0-5b33-4386-b801-f4c0585711ef service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:42.830838 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e2236fb-f9c2-4f6d-a9cd-0503b65c6acb req-7ecd65b0-5b33-4386-b801-f4c0585711ef service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:42.842065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4e2236fb-f9c2-4f6d-a9cd-0503b65c6acb req-7ecd65b0-5b33-4386-b801-f4c0585711ef service nova] Creating event network-changed:8c96acd7-4922-4cce-9604-cfd8b94ada60 for instance ffad6426-5a0d-4119-9cd7-c60407cc7972 on hv-cinder-82869 Sep 09 15:01:42.847659 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4e2236fb-f9c2-4f6d-a9cd-0503b65c6acb req-7ecd65b0-5b33-4386-b801-f4c0585711ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032007 Sep 09 15:01:42.848809 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 287/570] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:01:43.551435 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:43.551973 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:43.567302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:43.568083 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:43.568956 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:43.569710 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:43.570330 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:43.570819 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:43.798699 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:43.810293 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2b63433a-6093-4a8a-95b1-b5b879e3ea77 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1667 microversion: 2.1 time: 0.263806 Sep 09 15:01:43.811474 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 284/571] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:43 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1667 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:44.879385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-7f22415f-d44b-47a7-9194-70ca7fa164e1 req-d734c203-2003-45e5-857a-0254177c5c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf7d1b4-008f-427e-afeb-a09b91f9c1a6", "tag": "598629db-7d01-4336-8d90-bf7ea717cd23"}, {"name": "network-changed", "server_uuid": "aaf7d1b4-008f-427e-afeb-a09b91f9c1a6", "tag": "598629db-7d01-4336-8d90-bf7ea717cd23"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:44.890192 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7f22415f-d44b-47a7-9194-70ca7fa164e1 req-d734c203-2003-45e5-857a-0254177c5c45 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:44.890673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7f22415f-d44b-47a7-9194-70ca7fa164e1 req-d734c203-2003-45e5-857a-0254177c5c45 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:44.891180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7f22415f-d44b-47a7-9194-70ca7fa164e1 req-d734c203-2003-45e5-857a-0254177c5c45 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:44.902778 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-7f22415f-d44b-47a7-9194-70ca7fa164e1 req-d734c203-2003-45e5-857a-0254177c5c45 service nova] Creating event network-changed:598629db-7d01-4336-8d90-bf7ea717cd23 for instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 on hv-cinder-82869 Sep 09 15:01:44.903299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-7f22415f-d44b-47a7-9194-70ca7fa164e1 req-d734c203-2003-45e5-857a-0254177c5c45 service nova] Creating event network-changed:598629db-7d01-4336-8d90-bf7ea717cd23 for instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 on hv-cinder-82869 Sep 09 15:01:44.909076 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-7f22415f-d44b-47a7-9194-70ca7fa164e1 req-d734c203-2003-45e5-857a-0254177c5c45 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033912 Sep 09 15:01:44.909726 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 288/572] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:47.497764 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89fb82b3-5509-4f63-a35a-5fdfd5b93b2c"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:47.500213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:47.507667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:47.508156 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:47.508631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:47.509370 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:47.510189 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:47.511027 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:47.595147 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Invalid volume: volume 89fb82b3-5509-4f63-a35a-5fdfd5b93b2c is already attached to instances: 58941584-8b16-4d54-91ca-6565820ed69b Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: POST /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments HTTP/1.1 Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 74 Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:01:47.596928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {"volumeAttachment": {"volumeId": "89fb82b3-5509-4f63-a35a-5fdfd5b93b2c"}} Sep 09 15:01:47.598473 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Invalid volume: volume 89fb82b3-5509-4f63-a35a-5fdfd5b93b2c is already attached to instances: 58941584-8b16-4d54-91ca-6565820ed69b Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'server_id': '58941584-8b16-4d54-91ca-6565820ed69b', 'body': {'volumeAttachment': {'volumeId': '89fb82b3-5509-4f63-a35a-5fdfd5b93b2c'}}} Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 89fb82b3-5509-4f63-a35a-5fdfd5b93b2c is already attached to instances: 58941584-8b16-4d54-91ca-6565820ed69b Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:47.599290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 89fb82b3-5509-4f63-a35a-5fdfd5b93b2c is already attached to instances: 58941584-8b16-4d54-91ca-6565820ed69b Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:47.600374 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:01:47.601597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:01:47.601597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:01:47.601597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:01:47.601597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 89fb82b3-5509-4f63-a35a-5fdfd5b93b2c is already attached to instances: 58941584-8b16-4d54-91ca-6565820ed69b Sep 09 15:01:47.601597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:01:47.601597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 400 to user: Invalid volume: volume 89fb82b3-5509-4f63-a35a-5fdfd5b93b2c is already attached to instances: 58941584-8b16-4d54-91ca-6565820ed69b {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:01:47.601597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5c655283-fe43-4f17-89c9-fe67760e3f9a tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104773 Sep 09 15:01:47.601597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 285/573] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:01:47 2022] POST /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 15:01:47.663544 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:47.664118 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:47.670139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:47.670615 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:47.671044 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:47.671720 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:47.672166 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:47.673138 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:47.752131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lazy-loading 'services' on Instance uuid 58941584-8b16-4d54-91ca-6565820ed69b {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:01:47.821072 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f6db68c-f612-4391-8b21-84f1cf3b9742 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments/89fb82b3-5509-4f63-a35a-5fdfd5b93b2c" status: 202 len: 0 microversion: 2.1 time: 0.162098 Sep 09 15:01:47.821706 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 289/574] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:01:47 2022] DELETE /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments/89fb82b3-5509-4f63-a35a-5fdfd5b93b2c => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:01:47.832672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19877400-87fe-456d-afd2-a3d4a3b83084 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:47.835037 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-19877400-87fe-456d-afd2-a3d4a3b83084 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:47.841710 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19877400-87fe-456d-afd2-a3d4a3b83084 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:47.842191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19877400-87fe-456d-afd2-a3d4a3b83084 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:47.842837 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19877400-87fe-456d-afd2-a3d4a3b83084 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:47.843563 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19877400-87fe-456d-afd2-a3d4a3b83084 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:47.844014 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19877400-87fe-456d-afd2-a3d4a3b83084 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:47.844956 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19877400-87fe-456d-afd2-a3d4a3b83084 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:47.874843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-19877400-87fe-456d-afd2-a3d4a3b83084 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048301 Sep 09 15:01:47.875418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 286/575] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:01:47 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:01:48.888136 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce96b813-600d-4b5f-a626-093eea464670 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:48.890550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce96b813-600d-4b5f-a626-093eea464670 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:48.897832 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce96b813-600d-4b5f-a626-093eea464670 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:48.898303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce96b813-600d-4b5f-a626-093eea464670 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:48.898734 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce96b813-600d-4b5f-a626-093eea464670 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:48.899408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce96b813-600d-4b5f-a626-093eea464670 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:48.899872 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce96b813-600d-4b5f-a626-093eea464670 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:48.900273 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce96b813-600d-4b5f-a626-093eea464670 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:48.928740 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce96b813-600d-4b5f-a626-093eea464670 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044868 Sep 09 15:01:48.929300 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 290/576] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:01:48 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 15:01:48.991092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:48.991622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:48.997993 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:48.998479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:48.998910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:48.999594 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:49.000040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:49.001088 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:49.025516 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:01:49.028245 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:49.099786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2363efee-5c51-4d85-9207-e3a155cda196 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 204 len: 0 microversion: 2.1 time: 0.112218 Sep 09 15:01:49.100621 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 287/577] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:01:48 2022] DELETE /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:01:49.109193 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:49.110359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:49.116279 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:49.116758 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:49.117190 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:49.117894 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:49.118347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:49.118789 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:49.248407 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:49.256769 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8119ec06-1d73-4a45-a183-6afe5429bdf8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1681 microversion: 2.1 time: 0.151434 Sep 09 15:01:49.257435 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 291/578] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:49 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:50.280784 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:50.281578 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:50.287992 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:50.288476 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:50.288923 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:50.289651 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:50.290109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:50.290535 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:50.417395 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:50.426201 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ddc7383-26fb-4497-b81c-9ea983595df9 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1681 microversion: 2.1 time: 0.149711 Sep 09 15:01:50.426798 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 288/579] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:50 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:51.454961 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:51.455588 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:51.464882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:51.465407 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:51.465847 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:51.466557 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:51.467015 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:51.467445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:51.486198 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:51.561325 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:51.570024 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c827bd0-68ca-447a-9fe5-6d11002eda04 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 200 len: 1613 microversion: 2.1 time: 0.122419 Sep 09 15:01:51.570913 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 292/580] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:51 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 1613 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:51.748672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-36e8eb74-12bc-40c5-a890-f967f71af5f8 req-7d6f1569-84b9-4975-98ad-5483b4952d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58941584-8b16-4d54-91ca-6565820ed69b", "name": "network-vif-deleted", "tag": "a1c91661-7c07-4dc3-841f-ae251678bbd8"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:51.761976 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-36e8eb74-12bc-40c5-a890-f967f71af5f8 req-7d6f1569-84b9-4975-98ad-5483b4952d0d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:51.762446 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-36e8eb74-12bc-40c5-a890-f967f71af5f8 req-7d6f1569-84b9-4975-98ad-5483b4952d0d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:51.763101 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-36e8eb74-12bc-40c5-a890-f967f71af5f8 req-7d6f1569-84b9-4975-98ad-5483b4952d0d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:51.774968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-36e8eb74-12bc-40c5-a890-f967f71af5f8 req-7d6f1569-84b9-4975-98ad-5483b4952d0d service nova] Creating event network-vif-deleted:a1c91661-7c07-4dc3-841f-ae251678bbd8 for instance 58941584-8b16-4d54-91ca-6565820ed69b on hv-cinder-82869 Sep 09 15:01:51.782524 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-36e8eb74-12bc-40c5-a890-f967f71af5f8 req-7d6f1569-84b9-4975-98ad-5483b4952d0d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037034 Sep 09 15:01:51.784159 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 289/581] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:52.593956 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:52.595267 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:52.602234 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:52.602660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:52.603099 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:52.603796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:52.604308 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:52.604746 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:52.619977 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b HTTP/1.1 Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:01:52.621701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:01:52.623005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '58941584-8b16-4d54-91ca-6565820ed69b'} Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:01:52.623796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:01:52.624974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:01:52.626652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:01:52.626652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39540090-8578-4dc6-8e66-124e57a833fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 404 len: 111 microversion: 2.1 time: 0.033104 Sep 09 15:01:52.626652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 293/582] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:52 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:01:52.632975 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4866b32-9601-41db-b7df-b391b0bab6e3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '.version_select at 0x7f8ad25ae5e0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:52.652179 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4866b32-9601-41db-b7df-b391b0bab6e3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-677230621" status: 202 len: 0 microversion: 2.1 time: 0.023255 Sep 09 15:01:52.652758 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 290/583] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Sep 9 15:01:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-677230621 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:01:53.233233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99b42456-b0f1-435c-99a9-f6956d531477 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: .version_select at 0x7f8ad256d430>, body: {"keypair": {"name": "tempest-keypair-766870601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlR/uHfI/z4DcnUaOl+0ky4PoikmRvudoD0xBsc3GUBO/oiDG0oSldD65sL/keHqPWUC0JCkYWp6kC8pq/GE6ZJOSdEEZKSRNoIne2yFPYLnszX/hhqEp1Yvj8Etm47FQ=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:53.248554 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-99b42456-b0f1-435c-99a9-f6956d531477 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for project 063bdf7448ee45939287687b0e65dd97. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:01:53.252855 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-99b42456-b0f1-435c-99a9-f6956d531477 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for user 770105b06e084179a819a54d28b70cdf and project 063bdf7448ee45939287687b0e65dd97. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:01:53.275282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99b42456-b0f1-435c-99a9-f6956d531477 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046230 Sep 09 15:01:53.275875 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 294/584] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 15:01:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:01:54.527568 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-369062186", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ced1175-a542-4682-b032-b597d6969844"}], "security_groups": [{"name": "tempest-securitygroup--316985902"}], "key_name": "tempest-keypair-766870601", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:54.628987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] validate_networks() for [('2ced1175-a542-4682-b032-b597d6969844', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:01:54.988799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:01:54.989468 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:01:54.989958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:01:54.990373 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:01:54.990796 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:01:55.000543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:55.001649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:55.002097 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:55.002826 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:55.003281 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:55.003706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:55.020907 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for project 063bdf7448ee45939287687b0e65dd97. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:01:55.024863 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Getting quotas for user 770105b06e084179a819a54d28b70cdf and project 063bdf7448ee45939287687b0e65dd97. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:01:55.036958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:01:55.039393 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:01:55.087989 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-67826df1-811d-4c7b-89a1-f6161560d8ac tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565146 Sep 09 15:01:55.088554 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 291/585] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:01:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 15:01:55.099991 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4bedc155-bc57-40b6-8172-c504b8c6c96b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:55.100605 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4bedc155-bc57-40b6-8172-c504b8c6c96b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:55.159047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4bedc155-bc57-40b6-8172-c504b8c6c96b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:55.165791 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4bedc155-bc57-40b6-8172-c504b8c6c96b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1240 microversion: 2.1 time: 0.070093 Sep 09 15:01:55.166357 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 295/586] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:55 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:56.188831 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:56.189542 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:56.196791 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:56.197308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:56.197769 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:56.198713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:56.199165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:56.199875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:56.276185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:56.286064 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9f234802-05b5-4b70-8f6b-d1da45823337 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1292 microversion: 2.1 time: 0.101894 Sep 09 15:01:56.287669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 292/587] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:56 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:57.311526 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:57.312354 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:57.319441 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:57.319933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:57.320373 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:57.321079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:57.321630 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:57.322079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:57.531362 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:57.539329 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-045e60e5-b5da-49eb-bb4a-bcad2c99cbe3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1365 microversion: 2.1 time: 0.231759 Sep 09 15:01:57.540203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 296/588] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:57 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:01:57.647818 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-440e7bda-623b-45d7-8256-5178fc6a8c11 req-4d7606d7-f90c-4332-b250-315cea8e3771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4347b16f-4907-4b7a-b5e3-dc0b4e142116", "tag": "34211ad4-de4c-4d6e-b4ff-f5d49198d966"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:01:57.658221 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-440e7bda-623b-45d7-8256-5178fc6a8c11 req-4d7606d7-f90c-4332-b250-315cea8e3771 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:57.658988 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-440e7bda-623b-45d7-8256-5178fc6a8c11 req-4d7606d7-f90c-4332-b250-315cea8e3771 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:57.659700 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-440e7bda-623b-45d7-8256-5178fc6a8c11 req-4d7606d7-f90c-4332-b250-315cea8e3771 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:57.670814 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-440e7bda-623b-45d7-8256-5178fc6a8c11 req-4d7606d7-f90c-4332-b250-315cea8e3771 service nova] Creating event network-changed:34211ad4-de4c-4d6e-b4ff-f5d49198d966 for instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 on hv-cinder-82869 Sep 09 15:01:57.676266 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-440e7bda-623b-45d7-8256-5178fc6a8c11 req-4d7606d7-f90c-4332-b250-315cea8e3771 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032054 Sep 09 15:01:57.677014 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 293/589] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:01:58.562393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:58.562914 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:58.569364 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:58.569845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:58.570278 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:58.571080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:58.571951 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:58.572362 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:58.702646 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:58.710717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b61c85e-b127-4342-8571-4a101e77ffd8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1365 microversion: 2.1 time: 0.152310 Sep 09 15:01:58.711278 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 297/590] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:58 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:01:59.735477 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:01:59.736185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:01:59.742273 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:59.742775 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:59.743206 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:59.743902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:01:59.744362 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:01:59.744790 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:01:59.941693 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:01:59.949317 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4ef9bffe-cf44-4ab5-85d9-5fedf2a90ba1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1365 microversion: 2.1 time: 0.219134 Sep 09 15:01:59.949902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 294/591] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:01:59 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:00.972341 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:00.972944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:00.979319 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:00.979792 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:00.980218 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:00.980895 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:00.981384 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:00.981808 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:01.117368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:01.124947 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21a97b2c-12b6-4fb2-a266-f61bbcf78c06 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1365 microversion: 2.1 time: 0.157036 Sep 09 15:02:01.127154 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 298/592] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:00 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:02.147689 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:02.148304 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:02.154987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:02.155466 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:02.155904 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:02.156590 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:02.157651 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:02.158080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:02.289492 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:02.297233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d39d258-5bf1-4790-b987-60ad8422d014 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1365 microversion: 2.1 time: 0.153426 Sep 09 15:02:02.298481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 295/593] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:02 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:03.320679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:03.321218 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:03.327198 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:03.327682 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:03.328119 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:03.329339 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:03.329793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:03.330216 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:03.456873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:03.464510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-980a9d7c-1efa-48f1-a798-126711977751 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1365 microversion: 2.1 time: 0.147915 Sep 09 15:02:03.465074 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 299/594] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:03 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:04.486993 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:04.487610 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:04.494000 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:04.494482 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:04.494951 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:04.495642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:04.496096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:04.496522 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:04.628873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:04.637110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-08ff97e5-b699-4db4-8128-972cd7dc700c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1365 microversion: 2.1 time: 0.153954 Sep 09 15:02:04.637744 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 296/595] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:04 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:04.705413 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4a2278af-6554-4db7-a4b8-569114ebe5bf req-1d75919c-03e1-49b6-a07c-7d0be58a1f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4347b16f-4907-4b7a-b5e3-dc0b4e142116", "name": "network-vif-plugged", "status": "completed", "tag": "34211ad4-de4c-4d6e-b4ff-f5d49198d966"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:04.715472 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4a2278af-6554-4db7-a4b8-569114ebe5bf req-1d75919c-03e1-49b6-a07c-7d0be58a1f1f service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:04.715950 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4a2278af-6554-4db7-a4b8-569114ebe5bf req-1d75919c-03e1-49b6-a07c-7d0be58a1f1f service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:04.716378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4a2278af-6554-4db7-a4b8-569114ebe5bf req-1d75919c-03e1-49b6-a07c-7d0be58a1f1f service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:04.727352 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4a2278af-6554-4db7-a4b8-569114ebe5bf req-1d75919c-03e1-49b6-a07c-7d0be58a1f1f service nova] Creating event network-vif-plugged:34211ad4-de4c-4d6e-b4ff-f5d49198d966 for instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 on hv-cinder-82869 Sep 09 15:02:04.732424 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4a2278af-6554-4db7-a4b8-569114ebe5bf req-1d75919c-03e1-49b6-a07c-7d0be58a1f1f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030777 Sep 09 15:02:04.733046 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 300/596] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:05.661286 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:05.661940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:05.663868 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:05.664519 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:05.665776 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:05.671961 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:05.672568 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:05.673065 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:05.673890 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:05.675332 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:05.675766 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:05.805680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:05.813917 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0c6266c9-b4ea-4af0-b8d9-13f96ef38fa8 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1365 microversion: 2.1 time: 0.157119 Sep 09 15:02:05.814479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 297/597] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:05 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:06.833791 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:06.838393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:06.839089 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:06.840884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:06.847032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:06.847514 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:06.847953 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:06.848638 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:06.849093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:06.849554 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:06.982374 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:06.990517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6506c0c4-51d8-4769-9752-804daf3c62ee tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1365 microversion: 2.1 time: 0.157667 Sep 09 15:02:06.991088 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 301/598] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:06 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:08.016052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:08.016670 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:08.023207 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:08.023677 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:08.024128 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:08.024826 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:08.025316 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:08.025748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:08.156721 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:08.164309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2514b0f6-5b3a-4282-af49-2d2da9bd12ca tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1555 microversion: 2.1 time: 0.152136 Sep 09 15:02:08.164870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 298/599] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:08 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:08.186410 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb4cf4e3-e6bf-4362-b922-6bf673e70c3d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:08.187621 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb4cf4e3-e6bf-4362-b922-6bf673e70c3d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:08.195066 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4cf4e3-e6bf-4362-b922-6bf673e70c3d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:08.195850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4cf4e3-e6bf-4362-b922-6bf673e70c3d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:08.196363 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4cf4e3-e6bf-4362-b922-6bf673e70c3d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:08.197071 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4cf4e3-e6bf-4362-b922-6bf673e70c3d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:08.197581 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4cf4e3-e6bf-4362-b922-6bf673e70c3d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:08.198012 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4cf4e3-e6bf-4362-b922-6bf673e70c3d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:08.273678 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb4cf4e3-e6bf-4362-b922-6bf673e70c3d tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091179 Sep 09 15:02:08.274307 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 302/600] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 15:02:08 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:09.188453 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-e0210487-a4a0-40b1-9166-6f4f8280f5e5 req-60236ac3-7c69-4ef9-bc5d-ab334d15e139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4347b16f-4907-4b7a-b5e3-dc0b4e142116", "tag": "34211ad4-de4c-4d6e-b4ff-f5d49198d966"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:09.198385 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-e0210487-a4a0-40b1-9166-6f4f8280f5e5 req-60236ac3-7c69-4ef9-bc5d-ab334d15e139 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:09.198954 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-e0210487-a4a0-40b1-9166-6f4f8280f5e5 req-60236ac3-7c69-4ef9-bc5d-ab334d15e139 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:09.199457 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-e0210487-a4a0-40b1-9166-6f4f8280f5e5 req-60236ac3-7c69-4ef9-bc5d-ab334d15e139 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:09.210904 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-e0210487-a4a0-40b1-9166-6f4f8280f5e5 req-60236ac3-7c69-4ef9-bc5d-ab334d15e139 service nova] Creating event network-changed:34211ad4-de4c-4d6e-b4ff-f5d49198d966 for instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 on hv-cinder-82869 Sep 09 15:02:09.215928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-e0210487-a4a0-40b1-9166-6f4f8280f5e5 req-60236ac3-7c69-4ef9-bc5d-ab334d15e139 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031173 Sep 09 15:02:09.216517 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 299/601] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:19.295843 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:19.296593 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=40 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:19.300573 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:19.301101 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:19.308665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:19.309153 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:19.309616 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:19.310312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:19.310767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:19.311189 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:19.334850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lazy-loading 'flavor' on Instance uuid de85eb6c-027b-4f9b-95e0-654217d6514e {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:02:19.407920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2768aa7c-45d8-4791-9620-7dd899fcf073 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "POST /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e/action" status: 202 len: 0 microversion: 2.1 time: 0.113505 Sep 09 15:02:19.408521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 303/602] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:02:19 2022] POST /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:02:19.414724 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=5 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:19.415459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:19.420102 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:19.420802 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:19.428400 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:19.428891 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:19.429429 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:19.430123 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:19.430573 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:19.430995 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:19.622934 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:19.631197 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5243fb70-cd47-4fe1-b56d-adbef30b0edb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.218047 Sep 09 15:02:19.631764 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 300/603] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:19 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:20.657045 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:20.657781 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:20.663852 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:20.664329 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:20.664782 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:20.665491 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:20.665944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:20.666361 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:20.850982 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:20.858586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1664a9e-ff54-4dee-91ca-5b21b1d29915 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.207059 Sep 09 15:02:20.859145 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 304/604] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:20 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:21.882445 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:21.883057 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:21.889848 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:21.890334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:21.891262 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:21.891952 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:21.892403 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:21.892828 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:22.023515 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:22.032245 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-84091c46-7b2b-48b5-9290-33e56e6d4827 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.153047 Sep 09 15:02:22.032832 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 301/605] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:21 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:23.055649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:23.056265 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:23.062705 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.063192 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.063629 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.064323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.064780 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.065230 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.104153 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:23.104734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:23.111650 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.112130 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.112563 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.113286 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.113739 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.114160 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.196200 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lazy-loading 'services' on Instance uuid aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:02:23.200430 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:23.215884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29845930-3a44-492a-8dfc-698b581ffe36 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.163707 Sep 09 15:02:23.216475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 305/606] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:23 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:23.266926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ebceab9c-fcc8-4d02-834a-0bf573f8cf1a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments/a7c8c79f-df19-4cef-99fc-3dc14552871c" status: 202 len: 0 microversion: 2.1 time: 0.166437 Sep 09 15:02:23.267504 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 302/607] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:02:23 2022] DELETE /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments/a7c8c79f-df19-4cef-99fc-3dc14552871c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 15:02:23.275944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c4f705c-d8f9-46fa-99b5-1c42742275f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:23.278417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c4f705c-d8f9-46fa-99b5-1c42742275f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:23.285113 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c4f705c-d8f9-46fa-99b5-1c42742275f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.285637 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c4f705c-d8f9-46fa-99b5-1c42742275f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.286070 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c4f705c-d8f9-46fa-99b5-1c42742275f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.286980 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c4f705c-d8f9-46fa-99b5-1c42742275f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.287498 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c4f705c-d8f9-46fa-99b5-1c42742275f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.287957 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c4f705c-d8f9-46fa-99b5-1c42742275f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.320790 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c4f705c-d8f9-46fa-99b5-1c42742275f7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048800 Sep 09 15:02:23.321576 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 306/608] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:02:23 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:02:23.503830 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ddbc48e-0dbc-4885-a361-32e05ceff299 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:23.504337 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ddbc48e-0dbc-4885-a361-32e05ceff299 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:23.510540 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddbc48e-0dbc-4885-a361-32e05ceff299 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.511027 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddbc48e-0dbc-4885-a361-32e05ceff299 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.511467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddbc48e-0dbc-4885-a361-32e05ceff299 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.512153 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddbc48e-0dbc-4885-a361-32e05ceff299 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.512611 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddbc48e-0dbc-4885-a361-32e05ceff299 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.513037 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddbc48e-0dbc-4885-a361-32e05ceff299 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.536618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ddbc48e-0dbc-4885-a361-32e05ceff299 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/ips" status: 200 len: 152 microversion: 2.20 time: 0.037157 Sep 09 15:02:23.537217 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 303/609] 10.222.0.15 () {60 vars in 1289 bytes} [Fri Sep 9 15:02:23 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 15:02:23.603676 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5113046-52bd-45af-b3af-71a55922649b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:23.605844 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5113046-52bd-45af-b3af-71a55922649b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:23.611654 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5113046-52bd-45af-b3af-71a55922649b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.612140 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5113046-52bd-45af-b3af-71a55922649b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.612576 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5113046-52bd-45af-b3af-71a55922649b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.613287 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5113046-52bd-45af-b3af-71a55922649b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.613740 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5113046-52bd-45af-b3af-71a55922649b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.614162 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5113046-52bd-45af-b3af-71a55922649b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.642522 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5113046-52bd-45af-b3af-71a55922649b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042818 Sep 09 15:02:23.643079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 307/610] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:02:23 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 15:02:23.709145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:23.710034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:23.716822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.717410 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.717919 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.718677 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.719279 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.719767 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.753410 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:02:23.837185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed059b17-714a-422a-ba19-9e57470ed03c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 204 len: 0 microversion: 2.1 time: 0.131687 Sep 09 15:02:23.837864 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 304/611] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:02:23 2022] DELETE /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:02:23.847220 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:23.848042 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:23.854069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.854580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.855018 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.855710 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:23.856162 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:23.856585 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:23.983944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:23.993239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c735c66-3ea1-4cc9-b7d9-e606ba29ecbf tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1673 microversion: 2.1 time: 0.150792 Sep 09 15:02:23.993817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 308/612] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:23 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:24.240432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:24.241139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:24.247646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:24.248134 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:24.248587 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:24.249305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:24.249768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:24.250893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:24.334436 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-548f90f0-8978-4ce6-8a11-e9f1922fef3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:24.336763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-548f90f0-8978-4ce6-8a11-e9f1922fef3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:24.343548 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548f90f0-8978-4ce6-8a11-e9f1922fef3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:24.344617 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548f90f0-8978-4ce6-8a11-e9f1922fef3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:24.345079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548f90f0-8978-4ce6-8a11-e9f1922fef3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:24.345807 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548f90f0-8978-4ce6-8a11-e9f1922fef3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:24.346264 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548f90f0-8978-4ce6-8a11-e9f1922fef3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:24.346689 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-548f90f0-8978-4ce6-8a11-e9f1922fef3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:24.378716 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-548f90f0-8978-4ce6-8a11-e9f1922fef3d tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048685 Sep 09 15:02:24.379285 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 309/613] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:02:24 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:24.389929 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:24.398115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-70c857fc-fd7b-410c-a814-78362e2a4b39 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.161922 Sep 09 15:02:24.398674 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 305/614] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:24 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:25.015802 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:25.016434 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:25.023222 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:25.023712 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:25.024149 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:25.024840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:25.025339 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:25.025766 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:25.150896 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:25.158986 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7d3d571-dcdc-4bd7-9690-462ecdf10ca5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1673 microversion: 2.1 time: 0.147054 Sep 09 15:02:25.159554 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 310/615] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:25 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:25.391040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5a188179-6dd9-4780-b0ee-5c7deb96ca05 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:25.393273 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5a188179-6dd9-4780-b0ee-5c7deb96ca05 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:25.399591 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a188179-6dd9-4780-b0ee-5c7deb96ca05 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:25.400069 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a188179-6dd9-4780-b0ee-5c7deb96ca05 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:25.400503 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a188179-6dd9-4780-b0ee-5c7deb96ca05 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:25.401187 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a188179-6dd9-4780-b0ee-5c7deb96ca05 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:25.401658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a188179-6dd9-4780-b0ee-5c7deb96ca05 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:25.402080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a188179-6dd9-4780-b0ee-5c7deb96ca05 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:25.422744 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:25.423355 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:25.429642 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:25.430126 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:25.430562 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:25.431256 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:25.431707 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:25.431883 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5a188179-6dd9-4780-b0ee-5c7deb96ca05 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Sep 09 15:02:25.432130 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:25.432433 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 306/616] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:02:25 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:25.559394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:25.567190 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ccd9a04-91a7-4310-b1ad-9caa14bd74fb tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.148912 Sep 09 15:02:25.567759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 311/617] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:25 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:25.866576 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:25.867121 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:25.872991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:25.873505 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:25.873949 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:25.874642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:25.875100 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:25.875527 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:25.897942 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lazy-loading 'flavor' on Instance uuid 23ac907a-c540-41ce-bcc5-3339348a221b {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:02:26.118044 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-90cecb2b-03b8-4b48-a371-ded63ba24ffd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/action" status: 202 len: 0 microversion: 2.20 time: 0.304478 Sep 09 15:02:26.118622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 307/618] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Sep 9 15:02:25 2022] POST /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:02:26.126619 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:26.127227 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:26.133818 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:26.134460 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:26.134960 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:26.135628 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:26.136211 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:26.136814 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:26.182201 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:26.182901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:26.189864 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:26.190348 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:26.190781 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:26.191575 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:26.192033 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:26.192455 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:26.326008 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:26.334026 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:26.335497 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:26.336656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2efbdfa6-cc90-44f9-89f2-234f820f1655 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.213888 Sep 09 15:02:26.337236 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 312/619] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:26 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:26.352601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:26.361068 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f886779d-e878-4efd-9286-25882f0d49c4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1673 microversion: 2.1 time: 0.182990 Sep 09 15:02:26.361597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 308/620] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:26 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:26.443941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b23a97a8-35ff-481c-af31-dbcaece44b90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:26.446570 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b23a97a8-35ff-481c-af31-dbcaece44b90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:26.453567 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23a97a8-35ff-481c-af31-dbcaece44b90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:26.454079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23a97a8-35ff-481c-af31-dbcaece44b90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:26.454511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23a97a8-35ff-481c-af31-dbcaece44b90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:26.455194 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23a97a8-35ff-481c-af31-dbcaece44b90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:26.455645 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23a97a8-35ff-481c-af31-dbcaece44b90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:26.456067 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23a97a8-35ff-481c-af31-dbcaece44b90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:26.485026 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b23a97a8-35ff-481c-af31-dbcaece44b90 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Sep 09 15:02:26.485600 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 313/621] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:02:26 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:26.590165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:26.590779 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:26.598009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:26.598490 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:26.598935 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:26.599622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:26.600069 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:26.600489 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:26.820309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:26.827930 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a775e78a-354f-4aa7-8265-ba72d91ac176 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.241552 Sep 09 15:02:26.829047 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 309/622] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:26 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:27.363353 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:27.364113 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:27.369974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.370463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.370901 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.371600 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.372082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.372507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.383822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:27.384437 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:27.391812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.392301 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.393329 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.393468 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.393926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.394355 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.491723 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:27.499495 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4af90929-7d07-470b-a97e-fdf15c44e3ce tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1605 microversion: 2.1 time: 0.119428 Sep 09 15:02:27.500583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 310/623] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:27 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1605 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:27.505127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9ccd4353-114a-41c4-8266-290a06271e9f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:27.507349 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9ccd4353-114a-41c4-8266-290a06271e9f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:27.512931 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ccd4353-114a-41c4-8266-290a06271e9f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.513515 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ccd4353-114a-41c4-8266-290a06271e9f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.513956 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ccd4353-114a-41c4-8266-290a06271e9f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.515075 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ccd4353-114a-41c4-8266-290a06271e9f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.515075 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ccd4353-114a-41c4-8266-290a06271e9f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.516209 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ccd4353-114a-41c4-8266-290a06271e9f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.548705 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9ccd4353-114a-41c4-8266-290a06271e9f tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046869 Sep 09 15:02:27.549225 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 311/624] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:02:27 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 15:02:27.628663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:27.629336 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:27.636216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.636803 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.637336 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.638804 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.639347 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.641078 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.641393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:27.652426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:27.653980 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:27.665775 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:27.666925 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61fbbaa7-3475-4e82-b1f9-e27c30aaefdf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.307901 Sep 09 15:02:27.676281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 314/625] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:27 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:27.676842 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:02:27.681378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-6962cf3f-91cb-4dcc-8d24-bda8fedf0b63 req-0b7d4564-8991-4334-bcdb-f66b7c40a9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762529ff-2c14-4d96-85cb-3908b1f9e26b", "name": "network-vif-deleted", "tag": "112e83fe-adcc-47b0-8085-50326186abe9"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:27.694189 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6962cf3f-91cb-4dcc-8d24-bda8fedf0b63 req-0b7d4564-8991-4334-bcdb-f66b7c40a9d9 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.694691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6962cf3f-91cb-4dcc-8d24-bda8fedf0b63 req-0b7d4564-8991-4334-bcdb-f66b7c40a9d9 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.695110 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6962cf3f-91cb-4dcc-8d24-bda8fedf0b63 req-0b7d4564-8991-4334-bcdb-f66b7c40a9d9 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.727192 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-6962cf3f-91cb-4dcc-8d24-bda8fedf0b63 req-0b7d4564-8991-4334-bcdb-f66b7c40a9d9 service nova] Creating event network-vif-deleted:112e83fe-adcc-47b0-8085-50326186abe9 for instance 762529ff-2c14-4d96-85cb-3908b1f9e26b on hv-cinder-82869 Sep 09 15:02:27.737154 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-6962cf3f-91cb-4dcc-8d24-bda8fedf0b63 req-0b7d4564-8991-4334-bcdb-f66b7c40a9d9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059215 Sep 09 15:02:27.740067 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 315/626] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:27.802815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cf86104c-d0d4-43d1-bce4-64112c4fd10e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 204 len: 0 microversion: 2.1 time: 0.178177 Sep 09 15:02:27.804562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 312/627] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:02:27 2022] DELETE /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 15:02:27.814265 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:27.814977 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:27.823455 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.823952 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.824392 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.825107 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.825647 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.826075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.856585 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:27.857586 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:27.864459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.865455 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.866081 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:27.869369 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:27.869964 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:27.870472 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:28.019627 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:28.028216 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e607754-e01b-4cdf-9915-04767600a8dc tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1689 microversion: 2.1 time: 0.219261 Sep 09 15:02:28.030046 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 316/628] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:27 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1689 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:28.054180 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:28.062202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3b7f7068-0d77-47b6-a703-55b1013b0c49 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.213096 Sep 09 15:02:28.062939 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 313/629] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:27 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:28.523927 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:28.524544 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:28.531359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:28.531856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:28.532293 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:28.533002 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:28.533513 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:28.533950 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:28.565878 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:28.566359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:28.566790 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:28.567228 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lazy-loading 'fault' on Instance uuid 762529ff-2c14-4d96-85cb-3908b1f9e26b {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:02:28.608766 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:28.613183 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:28.618278 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1547165-1945-4ee5-8a99-c63b625a5265 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1326 microversion: 2.1 time: 0.098275 Sep 09 15:02:28.618855 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 317/630] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:28 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:28.697431 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:28.698044 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:28.704562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:28.705043 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:28.705518 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:28.706201 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:28.706652 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:28.707073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:28.835635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:28.844238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:28.845706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:28.847328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-851b577c-8bab-4bfb-a978-27f2ed006d65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.153794 Sep 09 15:02:28.848167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 314/631] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:28 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:29.052583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:29.053187 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:29.060747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:29.061243 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:29.061678 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:29.062354 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:29.062802 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:29.063220 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:29.086118 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:29.086679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:29.092538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:29.093024 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:29.093491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:29.094724 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:29.095178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:29.095600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:29.241143 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:29.248741 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3de27c64-ba78-47a6-b2cc-f26480904585 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1689 microversion: 2.1 time: 0.199950 Sep 09 15:02:29.249332 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 318/632] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:29 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:29.268765 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:29.276341 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-660ffd96-1444-4ffa-afd6-544559b08f08 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.194084 Sep 09 15:02:29.276902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 315/633] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:29 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:29.641574 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:29.642175 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:29.648633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:29.649110 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:29.649572 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:29.650251 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:29.650698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:29.651120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:29.682192 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:29.682663 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:29.683093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:29.683527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lazy-loading 'fault' on Instance uuid 762529ff-2c14-4d96-85cb-3908b1f9e26b {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:02:29.723322 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:29.730749 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eeda2b54-a393-44b2-92c3-4770451caf3c tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1326 microversion: 2.1 time: 0.093523 Sep 09 15:02:29.731316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 319/634] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:29 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:29.873610 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:29.874245 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:29.881238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:29.881725 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:29.882161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:29.882844 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:29.883297 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:29.883717 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:30.007658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:30.016397 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:30.017904 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:30.019068 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dcef4a07-951c-4c31-b7b5-b139e16b6e64 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.149342 Sep 09 15:02:30.019625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 316/635] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:29 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:30.272112 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:30.272668 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:30.278573 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:30.279050 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:30.279486 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:30.280416 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:30.280866 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:30.281926 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:30.299742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:30.300359 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:30.306276 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:30.306761 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:30.307202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:30.307923 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:30.308379 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:30.308803 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:30.478067 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:30.482301 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:30.486043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ce60542-5f78-4fcc-a916-66c526ffa113 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1689 microversion: 2.1 time: 0.217833 Sep 09 15:02:30.486698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 320/636] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:30 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1689 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:30.489975 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e8691d6a-e17c-444a-b6f4-bec88d007369 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.194060 Sep 09 15:02:30.490530 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 317/637] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:30 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:30.752584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:30.753257 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:30.759652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:30.760130 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:30.760561 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:30.761276 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:30.761734 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:30.762157 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:30.792732 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:30.793223 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:30.793676 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:30.794117 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lazy-loading 'fault' on Instance uuid 762529ff-2c14-4d96-85cb-3908b1f9e26b {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:02:30.833805 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:30.841362 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba535f8f-08d1-4ee5-bfd1-d037f05558e4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1326 microversion: 2.1 time: 0.092602 Sep 09 15:02:30.841931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 321/638] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:30 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:31.044293 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:31.044910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:31.051418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:31.051906 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:31.052346 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:31.053045 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:31.053530 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:31.053954 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:31.189836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:31.197959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:31.199405 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:31.200567 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37966756-7829-4747-a0ff-e83072c744b6 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.160178 Sep 09 15:02:31.201120 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 318/639] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:31 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:31.509457 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:31.510523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:31.513168 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:31.513806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:31.517477 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:31.518223 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:31.518523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:31.519304 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:31.519854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:31.520340 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:31.520980 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:31.521490 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:31.525694 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:31.525694 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:31.527099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:31.527552 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:31.814589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:31.822184 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6d31792-dcf9-4401-a17b-f7889958a430 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1689 microversion: 2.1 time: 0.316720 Sep 09 15:02:31.822756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 322/640] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:31 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1689 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:31.836682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:31.845066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7f5f9232-9cc6-4899-a4f9-f356d58961bf tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.335633 Sep 09 15:02:31.845659 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 319/641] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:31 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:31.864310 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:31.864912 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:31.870694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:31.871176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:31.871607 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:31.872296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:31.872745 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:31.873162 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:31.908836 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:31.909354 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:31.909786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:31.910229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lazy-loading 'fault' on Instance uuid 762529ff-2c14-4d96-85cb-3908b1f9e26b {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:02:31.994771 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:32.004502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2ff5292-25c3-4e5e-a44f-5a8e0b5cd12f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 200 len: 1326 microversion: 2.1 time: 0.143923 Sep 09 15:02:32.006011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 323/642] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:31 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 1326 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:32.227579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:32.228114 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:32.235449 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:32.235945 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:32.236386 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:32.237099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:32.237596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:32.238021 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:32.667282 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:32.678181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:32.679736 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:32.680916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a788ee27-67a8-47cd-986c-66418ca7d470 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.457557 Sep 09 15:02:32.681509 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 320/643] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:32 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:32.845874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:32.846495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:32.853381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:32.853726 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:32.854206 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:32.855380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:32.855850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:32.856298 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:32.867802 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:32.868462 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:32.887002 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:32.887503 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:32.887942 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:32.888649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:32.889113 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:32.889564 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:33.006069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:33.013950 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-def6fdf3-1dce-48d1-84bf-4af7cb911601 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1621 microversion: 2.1 time: 0.171932 Sep 09 15:02:33.025429 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 324/644] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:32 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1621 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:33.031802 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:33.032365 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:33.038613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:33.039093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:33.039521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:33.040214 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:33.040714 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:33.041130 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:33.054427 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] HTTP exception thrown: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Request method failure captured: Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b HTTP/1.1 Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1SW0dKu4KuzbnPGsDtvvComdLr7ClzAHVdlz08McaP_r0GzBkzJZrOFMyZymH0SNDhzKI8znucj8Os7HOt2MW7t2jcFJrkwUS6jOzQkRmWOAe7-QQ_Z2VwtcR6OONdyfrVy3CDJuBMjzs4hJf5U9kvXsnvjR22xd4xt-HSC8pHK0Xs Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:02:33.056080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e498d32cc51a4bad9cb21e58985ce63e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: b72887db5ed34dbebe0d5745cf77c4a8 Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:02:33.057582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '762529ff-2c14-4d96-85cb-3908b1f9e26b'} Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:33.058426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:02:33.060048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:33.061521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Returning 404 to user: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:33.061521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fd6ea09-9bdc-4d12-b6cb-91cd41f58f62 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 404 len: 111 microversion: 2.1 time: 0.031745 Sep 09 15:02:33.061521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 325/645] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:33 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:02:33.067932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb22cc1e-05aa-4c2e-af0b-521b0a0b24af tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '.version_select at 0x7f8ad258a0d0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:33.088446 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb22cc1e-05aa-4c2e-af0b-521b0a0b24af tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940244061" status: 202 len: 0 microversion: 2.1 time: 0.024640 Sep 09 15:02:33.089022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 326/646] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Sep 9 15:02:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940244061 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:02:33.164748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:33.175650 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4600c471-755c-4589-a79d-7cad6f487ee9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.311595 Sep 09 15:02:33.190489 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 321/647] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:32 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:33.383726 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c2109be9-ce3e-4154-b4e7-d67132beb4f4 req-6dbd882b-4041-4eac-8b3a-adcf6aeb50e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf7d1b4-008f-427e-afeb-a09b91f9c1a6", "name": "network-vif-deleted", "tag": "598629db-7d01-4336-8d90-bf7ea717cd23"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:33.398523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c2109be9-ce3e-4154-b4e7-d67132beb4f4 req-6dbd882b-4041-4eac-8b3a-adcf6aeb50e0 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:33.399267 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c2109be9-ce3e-4154-b4e7-d67132beb4f4 req-6dbd882b-4041-4eac-8b3a-adcf6aeb50e0 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:33.399932 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c2109be9-ce3e-4154-b4e7-d67132beb4f4 req-6dbd882b-4041-4eac-8b3a-adcf6aeb50e0 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:33.417899 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c2109be9-ce3e-4154-b4e7-d67132beb4f4 req-6dbd882b-4041-4eac-8b3a-adcf6aeb50e0 service nova] Creating event network-vif-deleted:598629db-7d01-4336-8d90-bf7ea717cd23 for instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 on hv-cinder-82869 Sep 09 15:02:33.425447 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c2109be9-ce3e-4154-b4e7-d67132beb4f4 req-6dbd882b-4041-4eac-8b3a-adcf6aeb50e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046331 Sep 09 15:02:33.426057 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 327/648] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:33.709101 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:33.709719 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:33.716166 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:33.716653 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:33.717288 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:33.718167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:33.718669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:33.719540 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:33.762903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef2f4a30-6e4d-4478-b47f-93c02a5c0684 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'create', calling method: .version_select at 0x7f8ad2652940>, body: {"keypair": {"name": "tempest-keypair-1703884082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXihjT8x69HFb66Gv0nOlswS/4ZENCmbVD57lp8pniTBpA9POsUw3fzeMEh5T5AW52fp0ETe50AASWTSbLyOYlxcgeShJ3TkKY2UfU9PII92o7T9v6rpmp0VSuHu8XcOQ=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:33.781220 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-ef2f4a30-6e4d-4478-b47f-93c02a5c0684 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Getting quotas for project e498d32cc51a4bad9cb21e58985ce63e. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:02:33.785637 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-ef2f4a30-6e4d-4478-b47f-93c02a5c0684 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Getting quotas for user b72887db5ed34dbebe0d5745cf77c4a8 and project e498d32cc51a4bad9cb21e58985ce63e. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:02:33.811682 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef2f4a30-6e4d-4478-b47f-93c02a5c0684 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053130 Sep 09 15:02:33.815208 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 328/649] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 15:02:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:33.895219 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:33.904582 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:33.906369 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:33.908013 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-da9c91eb-6a48-41e3-94e2-0fa23807d91f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.202980 Sep 09 15:02:33.908642 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 322/650] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:33 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:34.042492 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:34.043223 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:34.051121 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:34.051856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:34.052294 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:34.053168 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:34.053678 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:34.054122 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:34.135930 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:34.152968 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c958a38a-c57f-4f73-bdd0-ddd3ebef0cb7 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 200 len: 1621 microversion: 2.1 time: 0.114743 Sep 09 15:02:34.169534 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 329/651] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:34 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 1621 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:34.201467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:34.202334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:34.209236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:34.209764 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:34.210283 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:34.211053 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:34.211708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:34.212367 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:34.411286 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:34.423676 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-965f7d06-2f86-44f6-998a-a176b27b9c2d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.226591 Sep 09 15:02:34.424265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 323/652] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:34 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:34.933904 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:34.934532 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:34.940436 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:34.940922 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:34.941394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:34.942087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:34.942572 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:34.943001 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:35.168124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:35.179865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:35.181967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:35.183595 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1f9ed36-5b49-4c4e-94c0-95c35c0dea27 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.253577 Sep 09 15:02:35.184828 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:35.187491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: aaf7d1b4-008f-427e-afeb-a09b91f9c1a6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:35.199845 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:35.201170 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:35.202185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:35.203025 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 330/653] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:34 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:35.203289 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:35.203947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:35.204439 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:35.223787 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] HTTP exception thrown: Instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 could not be found. Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Request method failure captured: Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 HTTP/1.1 Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RR0jZmzYl6UcfRkFayyMlevi0Iywujzul1Umo2IJj8q3R3lNGGST6iKANfvVW7rK8VRcV6ayKXynC7q16_zsSpfiOcWY5Slgmp6Lg9c49wKS-gTk5TuP8_XXNmBJqyxP7u__YCnrB3K2TOU22wbicKV1v5-TlXeMuJ9zAizqRmqT0 Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:02:35.226107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8051535f56a4e17a0fa1eeab7c08ce7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: cd6c40dd492e40599324ef05011895f3 Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 could not be found. Sep 09 15:02:35.227768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': 'aaf7d1b4-008f-427e-afeb-a09b91f9c1a6'} Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 could not be found. Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:35.228641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 could not be found. Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 could not be found. Sep 09 15:02:35.233499 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:35.235618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Returning 404 to user: Instance aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:35.235618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e2503e11-934d-4ca4-bfb1-3d8334a00a6c tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6" status: 404 len: 111 microversion: 2.1 time: 0.054242 Sep 09 15:02:35.235618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 324/654] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:35 2022] GET /compute/v2.1/servers/aaf7d1b4-008f-427e-afeb-a09b91f9c1a6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:02:35.239366 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e12a3784-b36d-48df-840a-5400ff7e201a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '.version_select at 0x7f8ad2616e50>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:35.259442 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e12a3784-b36d-48df-840a-5400ff7e201a tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222634823" status: 202 len: 0 microversion: 2.1 time: 0.024068 Sep 09 15:02:35.260433 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 331/655] 10.222.0.15 () {58 vars in 1221 bytes} [Fri Sep 9 15:02:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222634823 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:02:35.380471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-726486900", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdb8f25d-969f-4b3f-93fd-134c876a47c8"}], "security_groups": [{"name": "tempest-securitygroup--1825570652"}], "key_name": "tempest-keypair-1703884082", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:35.446783 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:35.450214 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:35.454502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:35.454979 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:35.455396 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:35.456383 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:35.456902 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:35.457319 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:35.650298 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] validate_networks() for [('bdb8f25d-969f-4b3f-93fd-134c876a47c8', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:02:35.788973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:35.797519 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de1c57bc-c5c8-4839-93a6-22b16612b18f tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1567 microversion: 2.1 time: 0.354660 Sep 09 15:02:35.798183 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 332/656] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:35 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1567 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:35.820401 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:35.821001 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:35.826893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:35.827763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:35.827882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:35.828498 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:35.828953 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:35.829409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:35.953123 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120643) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 15:02:36.035765 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-985a6b5b-78f9-4417-988c-61a3fed900a0 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "POST /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e/action" status: 202 len: 0 microversion: 2.1 time: 0.218980 Sep 09 15:02:36.036294 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 333/657] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:02:35 2022] POST /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 15:02:36.045085 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:36.045821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:36.053428 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:36.054011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:36.054612 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:36.055393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:36.056034 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:36.056594 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:36.327606 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:36.342108 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7194ad0-1cea-43a6-a576-f9066d1e5229 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1515 microversion: 2.1 time: 0.301283 Sep 09 15:02:36.342871 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 334/658] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:36 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1515 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:36.348133 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:36.348988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:36.355058 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:36.355862 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:36.356691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:36.357707 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:36.358325 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:36.358931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:36.698726 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:02:36.699162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:02:36.703378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:02:36.703744 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:02:36.704207 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:02:36.733140 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:36.733657 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:36.735073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:36.735860 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:36.736267 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:36.736698 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:36.758008 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:36.766637 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:36.768093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:36.769452 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7054718-6e97-4d71-8c4d-3e5779ad2f96 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.424905 Sep 09 15:02:36.770011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 335/659] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:36 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:36.783133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Getting quotas for project e498d32cc51a4bad9cb21e58985ce63e. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:02:36.787547 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Getting quotas for user b72887db5ed34dbebe0d5745cf77c4a8 and project e498d32cc51a4bad9cb21e58985ce63e. Resources: {'ram', 'cores', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:02:36.800925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:02:36.804418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:02:36.859582 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb015e23-2861-4731-a75b-793db77d8722 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.482387 Sep 09 15:02:36.861036 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 325/660] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:02:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 15:02:36.872642 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b7862440-3e13-486f-ab4e-9f3b22aa1419 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:36.873835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b7862440-3e13-486f-ab4e-9f3b22aa1419 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:36.908130 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-a08d39ba-f3df-4104-88a8-379b971a6c08 req-71b1aa06-f0df-444d-b795-169bd32078f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de85eb6c-027b-4f9b-95e0-654217d6514e", "name": "network-vif-unplugged", "status": "completed", "tag": "e3d39b24-1d9b-4caf-a284-b75b3c187cde"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:36.922322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a08d39ba-f3df-4104-88a8-379b971a6c08 req-71b1aa06-f0df-444d-b795-169bd32078f5 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:36.923184 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a08d39ba-f3df-4104-88a8-379b971a6c08 req-71b1aa06-f0df-444d-b795-169bd32078f5 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:36.924107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a08d39ba-f3df-4104-88a8-379b971a6c08 req-71b1aa06-f0df-444d-b795-169bd32078f5 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:36.939696 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.compute.server_external_events [req-a08d39ba-f3df-4104-88a8-379b971a6c08 req-71b1aa06-f0df-444d-b795-169bd32078f5 service nova] Unable to find a host for instance de85eb6c-027b-4f9b-95e0-654217d6514e. Dropping event network-vif-unplugged {{(pid=120642) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 15:02:36.941471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-a08d39ba-f3df-4104-88a8-379b971a6c08 req-71b1aa06-f0df-444d-b795-169bd32078f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041317 Sep 09 15:02:36.943247 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 326/661] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 09 15:02:36.960289 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b7862440-3e13-486f-ab4e-9f3b22aa1419 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:36.967468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b7862440-3e13-486f-ab4e-9f3b22aa1419 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1237 microversion: 2.1 time: 0.099559 Sep 09 15:02:36.968066 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 336/662] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:36 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:37.366279 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:37.366928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:37.373275 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:37.373756 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:37.374187 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:37.375365 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:37.375816 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:37.376296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:37.557460 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:37.569093 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82aca170-225a-45ae-8031-b2f6d8cecc2c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1517 microversion: 2.1 time: 0.206685 Sep 09 15:02:37.569708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 327/663] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:37 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:37.795774 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:37.796381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:37.803256 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:37.803783 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:37.804218 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:37.804900 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:37.805382 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:37.805806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:37.932195 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:37.935758 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:37.941837 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:37.943292 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:37.944449 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af5d9366-efc0-49bd-b06a-805a312ad76c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.152589 Sep 09 15:02:37.945007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 337/664] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:37 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:37.990648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:37.991260 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:37.997255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:37.997735 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:37.998171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:37.998848 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:37.999301 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:38.000669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:38.061439 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:38.070196 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1b3bd88e-da68-4bab-8457-3247a42935b6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1289 microversion: 2.1 time: 0.083312 Sep 09 15:02:38.070776 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 328/665] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:37 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:38.595076 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:38.595884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:38.598350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:38.603540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:38.604022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:38.604456 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:38.605141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:38.605746 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:38.606181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:38.637060 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:38.637725 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:38.644721 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:38.645325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:38.645835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:38.646654 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:38.647182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:38.647703 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:38.666611 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:38.675017 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:02:38.753061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-041eaa54-1e59-4f6d-bd75-715f0b35b47e tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "DELETE /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 204 len: 0 microversion: 2.1 time: 0.119607 Sep 09 15:02:38.753782 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 329/666] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:02:38 2022] DELETE /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:02:38.762154 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:38.762637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:38.768995 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:38.769762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:38.770000 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:38.770699 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:38.771150 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:38.771621 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:38.885738 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:38.894303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9dd3acea-2103-45ae-9d56-ecdb64cde8a3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.304025 Sep 09 15:02:38.894877 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 338/667] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:38 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:38.969120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:38.970035 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:38.975988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:38.976475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:38.976906 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:38.977629 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:38.978083 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:38.978505 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:39.037049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:39.045585 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48ff6a33-1db7-4779-b362-5c113be82b91 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1507 microversion: 2.1 time: 0.287585 Sep 09 15:02:39.046684 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 330/668] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:38 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:39.094351 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:39.098087 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:39.108462 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:39.109305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:39.109925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:39.111098 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:39.112324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:39.113001 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:39.163330 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:39.173145 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:39.175129 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:39.176718 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88f3fd19-90b6-4922-bbc7-194e0cacf384 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.211616 Sep 09 15:02:39.197250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 339/669] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:38 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:02:39.260865 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:39.270053 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42f1c0bf-4e0f-44ef-9b48-e94892b8fda2 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.180540 Sep 09 15:02:39.270633 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 331/670] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:39 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:39.917728 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:39.918338 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:39.924779 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:39.925286 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:39.925726 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:39.926411 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:39.926860 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:39.927280 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:40.057756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:40.065706 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e115b761-0dbb-4f6f-9ead-2256c9b7cca9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.151776 Sep 09 15:02:40.066262 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 340/671] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:39 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:40.069708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:40.070325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:40.074295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:40.079339 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:40.079825 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:40.080257 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:40.080947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:40.081448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:40.081867 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:40.204865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:40.205636 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:40.211526 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:40.212011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:40.212448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:40.213142 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:40.213397 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:40.213620 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:40.214043 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:40.221594 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-730447b9-7c60-498a-b490-6a4265b905e9 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1507 microversion: 2.1 time: 0.156495 Sep 09 15:02:40.222160 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 332/672] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:40 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:40.292254 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:40.292871 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:40.298759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:40.299237 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:40.300306 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:40.301001 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:40.301488 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:40.301908 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:40.350702 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:40.358753 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:40.360201 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:40.361412 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c215f621-b902-4d34-b7cc-b97f51a07e8f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.160890 Sep 09 15:02:40.361982 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 341/673] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:40 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:02:40.430492 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:40.439111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2c8819cb-93f4-4eea-9438-b4c16b0dc8b7 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.150653 Sep 09 15:02:40.439672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 333/674] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:40 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:41.089538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:41.090084 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:41.097139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:41.097665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:41.098098 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:41.099022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:41.099484 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:41.099904 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:41.243905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:41.245713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:41.252180 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:41.252964 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:41.253595 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:41.254471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:41.255296 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:41.256446 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:41.475578 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:41.485660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce77127e-41e1-43be-a4a2-12279f2dbc28 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.400067 Sep 09 15:02:41.487420 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 342/675] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:41 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:41.493143 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:41.494056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:41.501441 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:41.502707 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:41.504335 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:41.505558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:41.506233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:41.506870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:41.740608 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:41.748543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f19fe89a-f637-4f7f-8473-f079658ffa48 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 200 len: 1507 microversion: 2.1 time: 0.508492 Sep 09 15:02:41.749110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 334/676] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:41 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 1507 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:41.754934 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:41.755609 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:41.764177 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:41.765056 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:41.766286 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:41.767245 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:41.768098 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:41.768631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:41.901648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:41.912047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:41.914032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:41.915673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-87da4940-3492-434e-851e-707596681e8d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.427078 Sep 09 15:02:41.916718 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 343/677] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:41 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:42.021445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-39619180-a3b5-41e5-89de-cf9975b842f4 req-612d7e54-498c-4ac3-8bf6-41e28f0266d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211a0b66-c743-4309-943c-b2d6afbee2c6", "name": "network-vif-deleted", "tag": "c8fdd88c-0583-47e2-a5ed-5152bcef3474"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:42.031975 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-39619180-a3b5-41e5-89de-cf9975b842f4 req-612d7e54-498c-4ac3-8bf6-41e28f0266d9 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.032494 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-39619180-a3b5-41e5-89de-cf9975b842f4 req-612d7e54-498c-4ac3-8bf6-41e28f0266d9 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.033129 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-39619180-a3b5-41e5-89de-cf9975b842f4 req-612d7e54-498c-4ac3-8bf6-41e28f0266d9 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.045842 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-39619180-a3b5-41e5-89de-cf9975b842f4 req-612d7e54-498c-4ac3-8bf6-41e28f0266d9 service nova] Creating event network-vif-deleted:c8fdd88c-0583-47e2-a5ed-5152bcef3474 for instance 211a0b66-c743-4309-943c-b2d6afbee2c6 on hv-cinder-82869 Sep 09 15:02:42.050919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-39619180-a3b5-41e5-89de-cf9975b842f4 req-612d7e54-498c-4ac3-8bf6-41e28f0266d9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132795 Sep 09 15:02:42.051533 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 344/678] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:42.066536 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:42.074529 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9aec8330-ff8a-4d58-ba25-8df2115ff053 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.323729 Sep 09 15:02:42.075098 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 335/679] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:41 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:42.169843 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-0ab984a5-911f-49d6-ae69-ece6612fc47d req-6695ec0a-6710-47af-92cf-32838d6fc2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704266ae-9ec2-45f2-b2ca-f5e6dcb07d76", "tag": "0f8216ec-5fd2-4d42-9e5c-1ff97e0dd9a3"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:42.181105 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0ab984a5-911f-49d6-ae69-ece6612fc47d req-6695ec0a-6710-47af-92cf-32838d6fc2a4 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.181695 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0ab984a5-911f-49d6-ae69-ece6612fc47d req-6695ec0a-6710-47af-92cf-32838d6fc2a4 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.182042 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0ab984a5-911f-49d6-ae69-ece6612fc47d req-6695ec0a-6710-47af-92cf-32838d6fc2a4 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.194061 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-0ab984a5-911f-49d6-ae69-ece6612fc47d req-6695ec0a-6710-47af-92cf-32838d6fc2a4 service nova] Creating event network-changed:0f8216ec-5fd2-4d42-9e5c-1ff97e0dd9a3 for instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 on hv-cinder-82869 Sep 09 15:02:42.198656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-0ab984a5-911f-49d6-ae69-ece6612fc47d req-6695ec0a-6710-47af-92cf-32838d6fc2a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033376 Sep 09 15:02:42.199414 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 345/680] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:42.513166 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:42.513815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:42.520157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.520636 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.521067 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.522531 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.523334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.523766 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.752819 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:42.760813 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6ee1f7b4-2cc4-4d7e-8181-6f7005c7cd7d tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.251453 Sep 09 15:02:42.761525 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 336/681] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:42 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:42.772424 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:42.773120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: 211a0b66-c743-4309-943c-b2d6afbee2c6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:42.779218 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.779703 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.780393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.781608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.782061 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.782480 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.795485 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] HTTP exception thrown: Instance 211a0b66-c743-4309-943c-b2d6afbee2c6 could not be found. Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Request method failure captured: Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 HTTP/1.1 Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RR0jZmzYl6UcfRkFayyMlevi0Iywujzul1Umo2IJj8q3R3lNGGST6iKANfvVW7rK8VRcV6ayKXynC7q16_zsSpfiOcWY5Slgmp6Lg9c49wKS-gTk5TuP8_XXNmBJqyxP7u__YCnrB3K2TOU22wbicKV1v5-TlXeMuJ9zAizqRmqT0 Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:02:42.797841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8051535f56a4e17a0fa1eeab7c08ce7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: cd6c40dd492e40599324ef05011895f3 Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 211a0b66-c743-4309-943c-b2d6afbee2c6 could not be found. Sep 09 15:02:42.799609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '211a0b66-c743-4309-943c-b2d6afbee2c6'} Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211a0b66-c743-4309-943c-b2d6afbee2c6 could not be found. Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:42.800580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211a0b66-c743-4309-943c-b2d6afbee2c6 could not be found. Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211a0b66-c743-4309-943c-b2d6afbee2c6 could not be found. Sep 09 15:02:42.802081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:42.803381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Returning 404 to user: Instance 211a0b66-c743-4309-943c-b2d6afbee2c6 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:42.803381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b66e54c4-fd84-4f13-ae38-f2846f8a0647 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6" status: 404 len: 111 microversion: 2.1 time: 0.030993 Sep 09 15:02:42.803381 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 346/682] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:42 2022] GET /compute/v2.1/servers/211a0b66-c743-4309-943c-b2d6afbee2c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 15:02:42.808685 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:42.809184 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:42.815897 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.816390 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.816832 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.817567 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.818028 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.818451 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.844755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:02:42.922253 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-13e74eed-fbfa-45b2-8f4a-054dfd235d27 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 204 len: 0 microversion: 2.1 time: 0.116956 Sep 09 15:02:42.923066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 337/683] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:02:42 2022] DELETE /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:02:42.931011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:42.931884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:42.941084 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.942609 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.943064 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.943774 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.944258 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.944683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.946528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:42.947240 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:42.954924 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.955709 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.956306 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:42.957232 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:42.957849 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:42.958432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:43.302787 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:43.305915 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:43.311008 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:43.313029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:43.314207 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fda7089a-0dec-4c39-a60e-e2c6b4b26475 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.372007 Sep 09 15:02:43.314418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c73da78-2552-47b0-a4ff-8ed8d6f28b99 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.387326 Sep 09 15:02:43.314765 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 338/684] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:42 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:43.315117 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 347/685] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:42 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:43.324707 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:43.325454 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:43.332480 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:43.332965 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:43.333440 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:43.334134 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:43.334591 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:43.335017 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:43.461736 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:43.469321 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ccb7ae77-5a4b-4bbf-a48a-b4b6bcbf673d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.148177 Sep 09 15:02:43.469891 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 339/686] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:43 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:43.787416 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:43.788020 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:43.793938 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:43.794419 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:43.794848 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:43.795525 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:43.795973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:43.796882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:43.928279 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:43.935924 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f6b9101-36a0-4bd0-b46c-20e22bb45200 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.152336 Sep 09 15:02:43.936482 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 348/687] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:43 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:44.338594 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:44.339210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:44.339574 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:44.340181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:44.346115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:44.346632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:44.346953 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:44.347068 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:44.347438 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:44.347754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:44.347873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:44.348210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:44.348531 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:44.348634 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:44.348979 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:44.349426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:44.538060 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:44.544997 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:44.545646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-97d77184-1db3-49cb-9dc8-bf0c357d1fef tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.210859 Sep 09 15:02:44.546220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 340/688] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:44 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:44.551630 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:44.552235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:44.553926 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:44.555482 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:44.556734 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0a1e53b1-a2dc-48c8-b425-f3d13dd0e320 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.220950 Sep 09 15:02:44.558037 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:44.558462 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:44.558777 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 349/689] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:44 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:02:44.567901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:44.567901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:44.567901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:44.567901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:44.691135 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:44.698659 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-00bf0e54-4858-4455-a947-e018e924c381 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.151404 Sep 09 15:02:44.699610 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 341/690] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:44 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:44.959739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:44.960346 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:44.966399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:44.966874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:44.967304 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:44.967983 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:44.968451 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:44.968870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:45.096120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:45.103720 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c249ffcd-0c9e-4a00-8dbc-80d5875922d3 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.147887 Sep 09 15:02:45.104272 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 350/691] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:44 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:45.568438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:45.569074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:45.575606 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:45.576093 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:45.576780 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:45.577539 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:45.577974 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:45.578389 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:45.583415 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:45.584019 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:45.590380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:45.590854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:45.591282 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:45.591964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:45.592418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:45.592835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:45.808810 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:45.812609 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:45.818235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ec4f35ce-ef70-49e6-b39c-ff14da86ca09 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1522 microversion: 2.1 time: 0.253638 Sep 09 15:02:45.822064 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 342/692] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:45 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:45.823533 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:45.825999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:45.826685 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:45.831530 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:45.833171 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:45.833420 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:45.834004 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:45.834366 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80f49e8c-dc1b-48ad-8b15-3409afb32081 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.254805 Sep 09 15:02:45.834485 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:45.837242 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 351/693] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:45 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:45.837398 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:45.837398 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:45.837398 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:46.081349 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:46.089363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e5dbd980-78a1-424e-84c3-6fdd8897cb15 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.269365 Sep 09 15:02:46.089854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 343/694] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:45 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:46.127385 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:46.128081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:46.134083 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:46.134676 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:46.141366 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:46.142296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:46.142933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:46.143548 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:46.439128 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:46.447029 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d091cfe-616e-4b7c-ae50-b02317da571c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.323432 Sep 09 15:02:46.447827 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 352/695] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:46 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:46.736517 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-a6386cf1-febb-4731-b385-be9b41502244 req-6c39b112-3a7a-443e-bb66-f248dc963577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbddff0a-cdd3-4537-821e-decd3714e96d", "name": "network-vif-deleted", "tag": "acf93c11-9610-4394-9769-af290e65bfdd"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:46.747052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a6386cf1-febb-4731-b385-be9b41502244 req-6c39b112-3a7a-443e-bb66-f248dc963577 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:46.747645 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a6386cf1-febb-4731-b385-be9b41502244 req-6c39b112-3a7a-443e-bb66-f248dc963577 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:46.748161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a6386cf1-febb-4731-b385-be9b41502244 req-6c39b112-3a7a-443e-bb66-f248dc963577 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:46.758057 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:46.760480 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-a6386cf1-febb-4731-b385-be9b41502244 req-6c39b112-3a7a-443e-bb66-f248dc963577 service nova] Creating event network-vif-deleted:acf93c11-9610-4394-9769-af290e65bfdd for instance fbddff0a-cdd3-4537-821e-decd3714e96d on hv-cinder-82869 Sep 09 15:02:46.765561 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-a6386cf1-febb-4731-b385-be9b41502244 req-6c39b112-3a7a-443e-bb66-f248dc963577 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086058 Sep 09 15:02:46.766137 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 344/696] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:46.842395 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:46.843013 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:46.849479 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:46.849978 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:46.850421 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:46.851115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:46.851573 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:46.852004 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:46.856870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:46.861649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:46.862349 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:46.868706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:46.869187 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:46.869653 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:46.870343 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:46.870806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:46.871256 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:46.916319 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:46.924756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2fc02b06-e412-4017-88ed-533a412ac047 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1480 microversion: 2.1 time: 0.086092 Sep 09 15:02:46.925276 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 353/697] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:46 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1480 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:47.016398 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:47.024942 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:47.026479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:47.028060 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0b782cb6-a8ab-4e31-8699-47500decb44d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.171683 Sep 09 15:02:47.028627 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 345/698] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:46 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:02:47.115365 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:47.115974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:47.117921 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:47.123164 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:47.123648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:47.124086 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:47.124803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:47.125283 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:47.125711 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:47.259046 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:47.266773 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c39a646-75b5-4ac1-bfe9-b0e0ee8be461 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.155191 Sep 09 15:02:47.267791 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 354/699] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:47 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:47.473520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:47.474146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:47.479984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:47.480465 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:47.480897 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:47.481617 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:47.482068 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:47.482487 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:47.610310 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:47.617948 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a21e9419-f11a-4fb2-b18a-b301f26cb0e4 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.148574 Sep 09 15:02:47.618504 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 346/700] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:47 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:47.948261 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:47.948876 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:47.956036 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:47.956522 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:47.956962 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:47.957690 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:47.958155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:47.958583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:47.988290 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:47.988767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:47.989227 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:47.989684 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lazy-loading 'fault' on Instance uuid fbddff0a-cdd3-4537-821e-decd3714e96d {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:02:48.031868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6c40dd492e40599324ef05011895f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8051535f56a4e17a0fa1eeab7c08ce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:48.039586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15891c44-5f8f-46c4-b99e-739f29d54dc0 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 200 len: 1312 microversion: 2.1 time: 0.095212 Sep 09 15:02:48.040154 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 355/701] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:47 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:48.055210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:48.055821 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:48.062653 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:48.063127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:48.063559 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:48.064239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:48.064689 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:48.065107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:48.192668 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:48.200578 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:48.201984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:48.203197 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9a7145d3-de33-4e17-8186-d0118d001e13 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1745 microversion: 2.20 time: 0.151796 Sep 09 15:02:48.203757 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 347/702] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:48 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:48.289316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:48.289952 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:48.295851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:48.296828 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:48.297363 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:48.298054 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:48.298508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:48.298931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:48.302926 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:48.438470 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:48.447534 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94b26397-5481-4bc0-bf0e-2949d6ceb058 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.162027 Sep 09 15:02:48.448110 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 356/703] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:48 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:48.642179 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:48.643094 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:48.649940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:48.650432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:48.650926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:48.651678 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:48.652156 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:48.652580 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:48.794510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:48.801443 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-886cda69-09c5-420d-a5b4-34a880445540 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.165085 Sep 09 15:02:48.802191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 348/704] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:48 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:49.061850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:49.062477 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] [instance: fbddff0a-cdd3-4537-821e-decd3714e96d] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:49.068772 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:49.069290 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:49.069739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:49.070435 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:49.070889 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:49.071314 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:49.084916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] HTTP exception thrown: Instance fbddff0a-cdd3-4537-821e-decd3714e96d could not be found. Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Request method failure captured: Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d HTTP/1.1 Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RR0jZmzYl6UcfRkFayyMlevi0Iywujzul1Umo2IJj8q3R3lNGGST6iKANfvVW7rK8VRcV6ayKXynC7q16_zsSpfiOcWY5Slgmp6Lg9c49wKS-gTk5TuP8_XXNmBJqyxP7u__YCnrB3K2TOU22wbicKV1v5-TlXeMuJ9zAizqRmqT0 Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:02:49.086520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8051535f56a4e17a0fa1eeab7c08ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8051535f56a4e17a0fa1eeab7c08ce7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: b8051535f56a4e17a0fa1eeab7c08ce7 Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1379136810 Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: cd6c40dd492e40599324ef05011895f3 Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1379136810-project Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance fbddff0a-cdd3-4537-821e-decd3714e96d could not be found. Sep 09 15:02:49.087824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': 'fbddff0a-cdd3-4537-821e-decd3714e96d'} Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbddff0a-cdd3-4537-821e-decd3714e96d could not be found. Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:49.088589 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbddff0a-cdd3-4537-821e-decd3714e96d could not be found. Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbddff0a-cdd3-4537-821e-decd3714e96d could not be found. Sep 09 15:02:49.089829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:49.090941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] Returning 404 to user: Instance fbddff0a-cdd3-4537-821e-decd3714e96d could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:49.090941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea3db9d4-30fd-4fca-be6a-8ff388023082 tempest-ServerRescueNegativeTestJSON-1379136810 tempest-ServerRescueNegativeTestJSON-1379136810-project] 10.222.0.15 "GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d" status: 404 len: 111 microversion: 2.1 time: 0.029914 Sep 09 15:02:49.090941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 357/705] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:49 2022] GET /compute/v2.1/servers/fbddff0a-cdd3-4537-821e-decd3714e96d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:02:49.228264 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:49.228884 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:49.235343 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:49.235835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:49.236275 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:49.236975 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:49.237491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:49.237920 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:49.371769 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:49.381735 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:49.383182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:49.384432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dbd1cdba-57b5-436b-ba1a-0aebf1b732e4 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1745 microversion: 2.20 time: 0.160178 Sep 09 15:02:49.384947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 349/706] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:49 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:49.474073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:49.475346 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:49.496850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:49.497394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:49.497836 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:49.498550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:49.499008 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:49.499945 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:49.661083 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:49.672838 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ce6404c-1191-4bc6-8dd0-6c8930c9f69d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.204572 Sep 09 15:02:49.674296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 358/707] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:49 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:49.826413 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:49.827025 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:49.833076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:49.833624 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:49.834074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:49.835428 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:49.835890 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:49.836323 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:49.978462 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:49.987198 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ff5b2ef1-d38c-46c2-8eea-4ecb9d3a6785 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.164555 Sep 09 15:02:49.987780 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 350/708] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:49 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:50.411368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:50.412560 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:50.431709 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:50.432491 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:50.433718 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:50.435445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:50.436069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:50.436652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:50.668813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:50.678640 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:50.687580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:50.696850 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:50.697667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:50.702488 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b37b32e1-8242-47dd-9fe7-f0559a4a3280 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.284377 Sep 09 15:02:50.705836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:50.706315 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 359/709] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:50 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:50.707028 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:50.707701 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:50.708629 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:50.709316 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:50.709947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:50.962310 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:50.971705 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-514debf1-4b0f-4c88-b0de-6dfe88ca4286 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.278479 Sep 09 15:02:50.982294 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 351/710] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:50 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:51.011044 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:51.011995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:51.026317 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:51.027037 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:51.027663 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:51.028558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:51.029219 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:51.030090 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:51.256814 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-fba13480-de30-4af3-86ed-02b34af18ae6 req-4c5ffe36-6816-437f-afe0-f9b94b390b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704266ae-9ec2-45f2-b2ca-f5e6dcb07d76", "name": "network-vif-plugged", "status": "completed", "tag": "0f8216ec-5fd2-4d42-9e5c-1ff97e0dd9a3"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:51.272095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-fba13480-de30-4af3-86ed-02b34af18ae6 req-4c5ffe36-6816-437f-afe0-f9b94b390b95 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:51.275510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-fba13480-de30-4af3-86ed-02b34af18ae6 req-4c5ffe36-6816-437f-afe0-f9b94b390b95 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:51.276079 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-fba13480-de30-4af3-86ed-02b34af18ae6 req-4c5ffe36-6816-437f-afe0-f9b94b390b95 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:51.293990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-fba13480-de30-4af3-86ed-02b34af18ae6 req-4c5ffe36-6816-437f-afe0-f9b94b390b95 service nova] Creating event network-vif-plugged:0f8216ec-5fd2-4d42-9e5c-1ff97e0dd9a3 for instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 on hv-cinder-82869 Sep 09 15:02:51.299826 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-fba13480-de30-4af3-86ed-02b34af18ae6 req-4c5ffe36-6816-437f-afe0-f9b94b390b95 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137900 Sep 09 15:02:51.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 352/711] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:02:51.420826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:51.431920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-012bcb57-2acb-4d0b-8f53-caa38f5874e6 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.424641 Sep 09 15:02:51.434965 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 360/712] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:51 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:51.734324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:51.736546 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:51.751379 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:51.752444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:51.755813 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:51.756811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:51.761189 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:51.762360 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:52.010741 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:52.011779 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:52.021831 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:52.049600 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:52.050337 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:52.051273 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:52.052071 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:52.052759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:52.060324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:52.076754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:52.081815 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:52.084096 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-067d0568-803d-4aa7-8ef2-84834182dd67 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.354888 Sep 09 15:02:52.087199 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 353/713] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:51 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:52.345970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:52.355816 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3eff941f-9a60-40c0-9970-710577a7eb21 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1363 microversion: 2.1 time: 0.349427 Sep 09 15:02:52.356623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 361/714] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:52 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:02:52.462876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:52.463785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:52.473461 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:52.480378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:52.481097 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:52.482135 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:52.482854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:52.483434 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:52.711088 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:52.721029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37b27df0-3488-4904-bab3-ae3fe703de12 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.262830 Sep 09 15:02:52.737575 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 354/715] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:52 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:52.872753 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26e0e758-7a3f-4214-8246-0e671c3b4dfe tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:52.873332 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26e0e758-7a3f-4214-8246-0e671c3b4dfe tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:52.884970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e0e758-7a3f-4214-8246-0e671c3b4dfe tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:52.887303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e0e758-7a3f-4214-8246-0e671c3b4dfe tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:52.888018 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e0e758-7a3f-4214-8246-0e671c3b4dfe tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:52.890465 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e0e758-7a3f-4214-8246-0e671c3b4dfe tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:52.891884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e0e758-7a3f-4214-8246-0e671c3b4dfe tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:52.893045 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e0e758-7a3f-4214-8246-0e671c3b4dfe tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:52.947443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26e0e758-7a3f-4214-8246-0e671c3b4dfe tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/ips" status: 200 len: 150 microversion: 2.1 time: 0.194987 Sep 09 15:02:52.962577 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 362/716] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 15:02:52 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/ips => generated 150 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:53.117407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:53.118024 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:53.127287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:53.127287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:53.129357 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:53.130106 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:53.132079 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:53.135169 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:53.326901 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-cf45d22e-f8ba-4a88-9779-d52b5f5e43e4 req-512ad7ee-7cac-4352-97aa-9b2bf1e0e609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ac907a-c540-41ce-bcc5-3339348a221b", "name": "network-vif-plugged", "status": "completed", "tag": "c8f3dda8-23ee-414a-9861-fbe66c356bcf"}, {"server_uuid": "de85eb6c-027b-4f9b-95e0-654217d6514e", "name": "network-vif-plugged", "status": "completed", "tag": "e3d39b24-1d9b-4caf-a284-b75b3c187cde"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:53.372716 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-cf45d22e-f8ba-4a88-9779-d52b5f5e43e4 req-512ad7ee-7cac-4352-97aa-9b2bf1e0e609 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:53.380182 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-cf45d22e-f8ba-4a88-9779-d52b5f5e43e4 req-512ad7ee-7cac-4352-97aa-9b2bf1e0e609 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:53.381357 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-cf45d22e-f8ba-4a88-9779-d52b5f5e43e4 req-512ad7ee-7cac-4352-97aa-9b2bf1e0e609 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:53.435135 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-cf45d22e-f8ba-4a88-9779-d52b5f5e43e4 req-512ad7ee-7cac-4352-97aa-9b2bf1e0e609 service nova] Creating event network-vif-plugged:c8f3dda8-23ee-414a-9861-fbe66c356bcf for instance 23ac907a-c540-41ce-bcc5-3339348a221b on hv-cinder-82869 Sep 09 15:02:53.440451 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-cf45d22e-f8ba-4a88-9779-d52b5f5e43e4 req-512ad7ee-7cac-4352-97aa-9b2bf1e0e609 service nova] Creating event network-vif-plugged:e3d39b24-1d9b-4caf-a284-b75b3c187cde for instance de85eb6c-027b-4f9b-95e0-654217d6514e on hv-cinder-82869 Sep 09 15:02:53.462336 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:53.490599 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-cf45d22e-f8ba-4a88-9779-d52b5f5e43e4 req-512ad7ee-7cac-4352-97aa-9b2bf1e0e609 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.167502 Sep 09 15:02:53.500655 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 363/717] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:53.509069 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:53.518493 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:53.526652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:53.528704 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:53.535435 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6f161fb5-26e3-49c8-b200-d06df36ec1e8 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.418746 Sep 09 15:02:53.541975 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 355/718] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:53 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:02:53.557248 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:53.565832 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:53.566302 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:53.567065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:53.567532 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:53.567975 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:53.751399 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:53.752065 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:53.762456 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:53.769605 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:53.773027 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:53.778805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:53.781656 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:53.783791 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:54.046092 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:54.054689 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-444743dc-0548-409e-a0ac-91bbf4a237e1 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1550 microversion: 2.1 time: 0.548156 Sep 09 15:02:54.060918 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 364/719] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:53 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1550 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:54.088732 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b138aedc-9d68-45b4-9c79-ea93179ea560 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:54.094425 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b138aedc-9d68-45b4-9c79-ea93179ea560 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:54.109943 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b138aedc-9d68-45b4-9c79-ea93179ea560 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:54.113883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b138aedc-9d68-45b4-9c79-ea93179ea560 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:54.114601 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b138aedc-9d68-45b4-9c79-ea93179ea560 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:54.116868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b138aedc-9d68-45b4-9c79-ea93179ea560 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:54.118614 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b138aedc-9d68-45b4-9c79-ea93179ea560 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:54.123928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b138aedc-9d68-45b4-9c79-ea93179ea560 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:54.127244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:54.138695 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-89027651-90c8-4f25-87e0-f40929cb69c9 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.392517 Sep 09 15:02:54.156177 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 356/720] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:53 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:54.244598 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b138aedc-9d68-45b4-9c79-ea93179ea560 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160665 Sep 09 15:02:54.253483 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 365/721] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 15:02:54 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:02:54.568299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:54.568833 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:54.576973 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:54.577673 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:54.578436 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:54.579715 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:54.580429 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:54.581392 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:54.772244 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec095013-ba81-4b35-b3c6-15a3e28fba3b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab469314-b056-44b0-b69a-f8b5edcda750"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:54.774886 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec095013-ba81-4b35-b3c6-15a3e28fba3b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:54.788737 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec095013-ba81-4b35-b3c6-15a3e28fba3b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:54.788990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:54.790054 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec095013-ba81-4b35-b3c6-15a3e28fba3b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:54.790653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec095013-ba81-4b35-b3c6-15a3e28fba3b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:54.791523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec095013-ba81-4b35-b3c6-15a3e28fba3b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:54.792134 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec095013-ba81-4b35-b3c6-15a3e28fba3b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:54.793770 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec095013-ba81-4b35-b3c6-15a3e28fba3b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:54.799223 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:54.800742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:54.802021 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5abd54dd-628a-4690-ac6c-d4e4e7318c65 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.237839 Sep 09 15:02:54.802973 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 357/722] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:54 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:55.167510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:55.168822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:55.180952 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:55.181695 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:55.182314 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:55.183380 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:55.184114 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:55.184674 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:55.226910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec095013-ba81-4b35-b3c6-15a3e28fba3b tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "POST /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468036 Sep 09 15:02:55.228835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 366/723] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:02:54 2022] POST /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:02:55.396167 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:55.407039 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2e66c27-d469-49b6-9eff-78687d61b00a tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1573 microversion: 2.1 time: 0.247169 Sep 09 15:02:55.408371 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 358/724] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:55 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:55.829486 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:55.831134 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:55.841218 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:55.841729 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:55.842170 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:55.843764 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:55.844458 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:55.844856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:56.011270 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5be85154-9ac8-4579-be5b-23595273928e tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Action: 'create', calling method: .version_select at 0x7f8ad258b5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1844178143", "metadata": {"Type": "work"}}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5be85154-9ac8-4579-be5b-23595273928e tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Request method failure captured: Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 122 Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1WfTTAjb9PFrXEeaxdxrVLAlwlgWU5jrCADMNmmyItSTmv5IAIkEt1dPg6ZMzr_tt4ZaKtQMCkz7c8R0A1BVQWBRMPD4ZjQbC-ReU7IkNgSKK9XrqjsbWdsziAbLo1tDo_j8n4OcOIug79HFzue1ZeBj8cOpvoxowBkeDLE6JFuZlw Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:02:56.031933 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/638634f2c79b473486cabd8292095f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_638634f2c79b473486cabd8292095f2d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 9430ca7bb90246ff84d0b9e4f762d953 Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1844178143", "metadata": {"Type": "work"}}} Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: Sep 09 15:02:56.033558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1844178143', 'metadata': {'Type': 'work'}}}} Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise error Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:56.034658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 15:02:56.036242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 15:02:56.037685 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 15:02:56.037685 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.037845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:56.039996 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5be85154-9ac8-4579-be5b-23595273928e tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:56.041303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5be85154-9ac8-4579-be5b-23595273928e tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.206607 Sep 09 15:02:56.045536 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:56.047729 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 359/725] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Sep 9 15:02:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 15:02:56.060165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22c54f6c-e189-4689-94a4-dedb4dca4192 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Action: 'create', calling method: .version_select at 0x7f8ad255d8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1417745763", "metadata": {"Type": "work"}}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:56.062206 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22c54f6c-e189-4689-94a4-dedb4dca4192 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Request method failure captured: Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 120 Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1WfTTAjb9PFrXEeaxdxrVLAlwlgWU5jrCADMNmmyItSTmv5IAIkEt1dPg6ZMzr_tt4ZaKtQMCkz7c8R0A1BVQWBRMPD4ZjQbC-ReU7IkNgSKK9XrqjsbWdsziAbLo1tDo_j8n4OcOIug79HFzue1ZeBj8cOpvoxowBkeDLE6JFuZlw Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:02:56.065679 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/638634f2c79b473486cabd8292095f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_638634f2c79b473486cabd8292095f2d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 9430ca7bb90246ff84d0b9e4f762d953 Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1417745763", "metadata": {"Type": "work"}}} Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: Sep 09 15:02:56.067216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1417745763', 'metadata': {'Type': 'work'}}}} Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise error Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi '0' Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:56.068146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 15:02:56.069716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 15:02:56.070999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 15:02:56.070999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.071915 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22c54f6c-e189-4689-94a4-dedb4dca4192 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:56.073601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-22c54f6c-e189-4689-94a4-dedb4dca4192 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024783 Sep 09 15:02:56.079550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-18666248-8854-43c2-836b-8180d6924bc2 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.239812 Sep 09 15:02:56.079860 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 360/726] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Sep 9 15:02:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 15:02:56.080607 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 367/727] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:55 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:56.102076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4e2836f-f177-4c20-8a1a-5cd7c349108e tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Action: 'create', calling method: .version_select at 0x7f8ad255d550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1098951722", "metadata": {"Type": "work"}}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4e2836f-f177-4c20-8a1a-5cd7c349108e tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Request method failure captured: Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 119 Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1WfTTAjb9PFrXEeaxdxrVLAlwlgWU5jrCADMNmmyItSTmv5IAIkEt1dPg6ZMzr_tt4ZaKtQMCkz7c8R0A1BVQWBRMPD4ZjQbC-ReU7IkNgSKK9XrqjsbWdsziAbLo1tDo_j8n4OcOIug79HFzue1ZeBj8cOpvoxowBkeDLE6JFuZlw Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:02:56.112664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/638634f2c79b473486cabd8292095f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_638634f2c79b473486cabd8292095f2d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 9430ca7bb90246ff84d0b9e4f762d953 Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1098951722", "metadata": {"Type": "work"}}} Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: Sep 09 15:02:56.114244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1098951722', 'metadata': {'Type': 'work'}}}} Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise error Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi '' Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:56.115235 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 15:02:56.117007 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 15:02:56.118338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 15:02:56.118338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.118338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4e2836f-f177-4c20-8a1a-5cd7c349108e tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:56.118338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4e2836f-f177-4c20-8a1a-5cd7c349108e tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030695 Sep 09 15:02:56.123024 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 361/728] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Sep 9 15:02:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 15:02:56.128051 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe68b959-84b5-4d7f-a5dd-3f6b8f3691eb tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Calling method '.version_select at 0x7f8ad251fee0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:56.171874 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-569474da-209b-4fa3-8e31-5c143ed91997 req-3366f4ad-99ad-420f-bd72-6606a3c1a167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704266ae-9ec2-45f2-b2ca-f5e6dcb07d76", "tag": "0f8216ec-5fd2-4d42-9e5c-1ff97e0dd9a3"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:02:56.185422 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-569474da-209b-4fa3-8e31-5c143ed91997 req-3366f4ad-99ad-420f-bd72-6606a3c1a167 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:56.186222 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-569474da-209b-4fa3-8e31-5c143ed91997 req-3366f4ad-99ad-420f-bd72-6606a3c1a167 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:56.187030 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-569474da-209b-4fa3-8e31-5c143ed91997 req-3366f4ad-99ad-420f-bd72-6606a3c1a167 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:56.200481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-569474da-209b-4fa3-8e31-5c143ed91997 req-3366f4ad-99ad-420f-bd72-6606a3c1a167 service nova] Creating event network-changed:0f8216ec-5fd2-4d42-9e5c-1ff97e0dd9a3 for instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 on hv-cinder-82869 Sep 09 15:02:56.200856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-fe68b959-84b5-4d7f-a5dd-3f6b8f3691eb tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] HTTP exception thrown: Volume tempest-invalid-909582585 could not be found. Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe68b959-84b5-4d7f-a5dd-3f6b8f3691eb tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Request method failure captured: Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-909582585 HTTP/1.1 Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1WfTTAjb9PFrXEeaxdxrVLAlwlgWU5jrCADMNmmyItSTmv5IAIkEt1dPg6ZMzr_tt4ZaKtQMCkz7c8R0A1BVQWBRMPD4ZjQbC-ReU7IkNgSKK9XrqjsbWdsziAbLo1tDo_j8n4OcOIug79HFzue1ZeBj8cOpvoxowBkeDLE6JFuZlw Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:02:56.204409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/638634f2c79b473486cabd8292095f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_638634f2c79b473486cabd8292095f2d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 9430ca7bb90246ff84d0b9e4f762d953 Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Volume tempest-invalid-909582585 could not be found. Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': 'tempest-invalid-909582585'} Sep 09 15:02:56.210798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-909582585 could not be found. (HTTP 404) (Request-ID: req-e3a43bf4-f4e5-44d1-8e2d-e4942063d169) Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.211810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 15:02:56.213467 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-909582585 could not be found. Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:02:56.214824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-909582585 could not be found. Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-909582585 could not be found. Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe68b959-84b5-4d7f-a5dd-3f6b8f3691eb tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Returning 404 to user: Volume tempest-invalid-909582585 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe68b959-84b5-4d7f-a5dd-3f6b8f3691eb tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-909582585" status: 404 len: 98 microversion: 2.1 time: 0.083217 Sep 09 15:02:56.216347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 368/729] 10.222.0.15 () {58 vars in 1215 bytes} [Fri Sep 9 15:02:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-909582585 => generated 98 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 09 15:02:56.223297 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea2e209f-0908-4669-893a-2ad35669697b tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003698 Sep 09 15:02:56.223297 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 369/730] 10.222.0.15 () {58 vars in 1140 bytes} [Fri Sep 9 15:02:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 09 15:02:56.225490 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-569474da-209b-4fa3-8e31-5c143ed91997 req-3366f4ad-99ad-420f-bd72-6606a3c1a167 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058793 Sep 09 15:02:56.226375 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 362/731] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:02:56.227688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c55704cc-29ae-4fae-8658-a42fca32a02e tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004336 Sep 09 15:02:56.228181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 370/732] 10.222.0.15 () {58 vars in 1137 bytes} [Fri Sep 9 15:02:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 09 15:02:56.242014 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e67966b6-823a-4eb4-81e6-08067656a6b8 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Calling method '.version_select at 0x7f8ad25cda60>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:56.276747 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-e67966b6-823a-4eb4-81e6-08067656a6b8 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] HTTP exception thrown: Volume 7a323114-62d7-465e-8a6c-6e0ee6db4717 could not be found. Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e67966b6-823a-4eb4-81e6-08067656a6b8 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Request method failure captured: Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: DELETE /compute/v2.1/os-volumes/7a323114-62d7-465e-8a6c-6e0ee6db4717 HTTP/1.1 Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1WfTTAjb9PFrXEeaxdxrVLAlwlgWU5jrCADMNmmyItSTmv5IAIkEt1dPg6ZMzr_tt4ZaKtQMCkz7c8R0A1BVQWBRMPD4ZjQbC-ReU7IkNgSKK9XrqjsbWdsziAbLo1tDo_j8n4OcOIug79HFzue1ZeBj8cOpvoxowBkeDLE6JFuZlw Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:02:56.281182 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/638634f2c79b473486cabd8292095f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_638634f2c79b473486cabd8292095f2d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 9430ca7bb90246ff84d0b9e4f762d953 Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Volume 7a323114-62d7-465e-8a6c-6e0ee6db4717 could not be found. Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '7a323114-62d7-465e-8a6c-6e0ee6db4717'} Sep 09 15:02:56.282772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a323114-62d7-465e-8a6c-6e0ee6db4717 could not be found. (HTTP 404) (Request-ID: req-fe7d3c25-4a4e-443b-a95f-eed9875a2569) Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.283706 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 15:02:56.285040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a323114-62d7-465e-8a6c-6e0ee6db4717 could not be found. Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 15:02:56.286672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a323114-62d7-465e-8a6c-6e0ee6db4717 could not be found. Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a323114-62d7-465e-8a6c-6e0ee6db4717 could not be found. Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e67966b6-823a-4eb4-81e6-08067656a6b8 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Returning 404 to user: Volume 7a323114-62d7-465e-8a6c-6e0ee6db4717 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e67966b6-823a-4eb4-81e6-08067656a6b8 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/7a323114-62d7-465e-8a6c-6e0ee6db4717" status: 404 len: 109 microversion: 2.1 time: 0.046419 Sep 09 15:02:56.289157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 363/733] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 15:02:56 2022] DELETE /compute/v2.1/os-volumes/7a323114-62d7-465e-8a6c-6e0ee6db4717 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:02:56.293255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-813f06c5-e6d1-4ea6-a0c6-92cc73cb90f9 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Calling method '.version_select at 0x7f8ad24fbca0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:56.365004 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-813f06c5-e6d1-4ea6-a0c6-92cc73cb90f9 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] HTTP exception thrown: Volume 03f4a18e-f7ef-4b86-a207-8d1491c1f144 could not be found. Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-813f06c5-e6d1-4ea6-a0c6-92cc73cb90f9 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Request method failure captured: Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-volumes/03f4a18e-f7ef-4b86-a207-8d1491c1f144 HTTP/1.1 Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1WfTTAjb9PFrXEeaxdxrVLAlwlgWU5jrCADMNmmyItSTmv5IAIkEt1dPg6ZMzr_tt4ZaKtQMCkz7c8R0A1BVQWBRMPD4ZjQbC-ReU7IkNgSKK9XrqjsbWdsziAbLo1tDo_j8n4OcOIug79HFzue1ZeBj8cOpvoxowBkeDLE6JFuZlw Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:02:56.366995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/638634f2c79b473486cabd8292095f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/638634f2c79b473486cabd8292095f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_638634f2c79b473486cabd8292095f2d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 638634f2c79b473486cabd8292095f2d Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-90607247 Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 9430ca7bb90246ff84d0b9e4f762d953 Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-90607247-project Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Volume 03f4a18e-f7ef-4b86-a207-8d1491c1f144 could not be found. Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '03f4a18e-f7ef-4b86-a207-8d1491c1f144'} Sep 09 15:02:56.368303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03f4a18e-f7ef-4b86-a207-8d1491c1f144 could not be found. (HTTP 404) (Request-ID: req-b2139d90-1a47-4a40-ba25-1334d3843280) Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.369080 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:02:56.370233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03f4a18e-f7ef-4b86-a207-8d1491c1f144 could not be found. Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 15:02:56.373973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03f4a18e-f7ef-4b86-a207-8d1491c1f144 could not be found. Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03f4a18e-f7ef-4b86-a207-8d1491c1f144 could not be found. Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-813f06c5-e6d1-4ea6-a0c6-92cc73cb90f9 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] Returning 404 to user: Volume 03f4a18e-f7ef-4b86-a207-8d1491c1f144 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-813f06c5-e6d1-4ea6-a0c6-92cc73cb90f9 tempest-VolumesNegativeTest-90607247 tempest-VolumesNegativeTest-90607247-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/03f4a18e-f7ef-4b86-a207-8d1491c1f144" status: 404 len: 109 microversion: 2.1 time: 0.079026 Sep 09 15:02:56.375793 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 371/734] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:02:56 2022] GET /compute/v2.1/os-volumes/03f4a18e-f7ef-4b86-a207-8d1491c1f144 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 15:02:56.432111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:56.432867 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:56.447620 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:56.448132 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:56.451387 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:56.453059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:56.460552 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:56.477587 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:56.800342 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:56.808192 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7a5ce4a6-ffe6-419a-b991-6dd6648fb980 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1560 microversion: 2.1 time: 0.380526 Sep 09 15:02:56.823581 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 364/735] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:02:56 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1560 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:02:57.111176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:57.114633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:57.131096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:57.133472 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:57.134961 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:57.136040 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:57.136707 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:57.137398 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:57.375267 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:57.386923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:57.388430 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:57.403432 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-063e8fdc-4a59-4805-a3f6-91e15423f653 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.283187 Sep 09 15:02:57.404316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 372/736] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:57 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:58.435902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:58.436646 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:58.443597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:58.444327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:58.444966 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:58.445902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:58.446553 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:58.452325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:58.473734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:58.640959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:58.649463 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:58.651143 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:58.652459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b8a745c5-f201-4e2c-b30f-8cc4cdc21b38 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.220708 Sep 09 15:02:58.652863 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 365/737] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:58 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:02:59.681164 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:02:59.681918 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:02:59.691881 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:59.692730 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:59.693474 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:59.694425 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:02:59.695105 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:02:59.695765 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:02:59.852727 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:59.861920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:59.863380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:02:59.864723 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62af9cda-6362-4438-9b87-e9de691f965a tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.188335 Sep 09 15:02:59.865947 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 373/738] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:02:59 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:00.891512 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:00.892770 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:00.906284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:00.907092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:00.908895 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:00.912000 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:00.912507 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:00.912939 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:01.106930 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:01.118620 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:01.120051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:01.121739 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fbbc0337-b124-4a25-a756-267033f9a6ac tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.234581 Sep 09 15:03:01.137512 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 366/739] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:00 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:02.153310 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:02.155633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:02.169683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:02.170408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:02.171430 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:02.172818 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:02.173638 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:02.174346 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:02.406494 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:02.414752 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:02.416204 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:02.417382 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb926d8b-bfe1-4c1d-940a-f59e357485ca tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.271113 Sep 09 15:03:02.417940 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 374/740] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:02 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:03.099188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:03.099671 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:03.106075 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:03.106571 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:03.107000 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:03.107684 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:03.108136 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:03.109246 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:03.186176 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lazy-loading 'services' on Instance uuid 4347b16f-4907-4b7a-b5e3-dc0b4e142116 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:03:03.257384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d2642474-5ea2-4999-946a-070c49cf9e10 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments/ab469314-b056-44b0-b69a-f8b5edcda750" status: 202 len: 0 microversion: 2.1 time: 0.161801 Sep 09 15:03:03.257976 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 367/741] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:03:03 2022] DELETE /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments/ab469314-b056-44b0-b69a-f8b5edcda750 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:03:03.266604 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f0d9ee6-744f-4de2-8a76-a7ef9ae429b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:03.268849 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f0d9ee6-744f-4de2-8a76-a7ef9ae429b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:03.275273 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f0d9ee6-744f-4de2-8a76-a7ef9ae429b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:03.275966 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f0d9ee6-744f-4de2-8a76-a7ef9ae429b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:03.276402 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f0d9ee6-744f-4de2-8a76-a7ef9ae429b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:03.277092 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f0d9ee6-744f-4de2-8a76-a7ef9ae429b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:03.277573 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f0d9ee6-744f-4de2-8a76-a7ef9ae429b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:03.277998 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f0d9ee6-744f-4de2-8a76-a7ef9ae429b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:03.309988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f0d9ee6-744f-4de2-8a76-a7ef9ae429b1 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047686 Sep 09 15:03:03.310540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 375/742] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:03:03 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:03.443461 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:03.444074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:03.450172 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:03.450651 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:03.451084 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:03.451764 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:03.452708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:03.453155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:03.585596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:03.593606 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:03.595042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:03.596311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-67f8feae-2eab-4de0-abd7-403429018372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.157186 Sep 09 15:03:03.596873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 368/743] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:03 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:04.325180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a97010e-d78f-4a3c-accc-bb14d67125b4 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:04.328845 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a97010e-d78f-4a3c-accc-bb14d67125b4 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:04.335631 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a97010e-d78f-4a3c-accc-bb14d67125b4 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:04.336096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a97010e-d78f-4a3c-accc-bb14d67125b4 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:04.336532 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a97010e-d78f-4a3c-accc-bb14d67125b4 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:04.337488 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a97010e-d78f-4a3c-accc-bb14d67125b4 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:04.337934 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a97010e-d78f-4a3c-accc-bb14d67125b4 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:04.338350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a97010e-d78f-4a3c-accc-bb14d67125b4 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:04.369169 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a97010e-d78f-4a3c-accc-bb14d67125b4 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050509 Sep 09 15:03:04.369736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 376/744] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:03:04 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:04.621953 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:04.622482 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:04.628867 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:04.629381 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:04.629813 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:04.630496 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:04.630962 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:04.631370 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:04.767144 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:04.775061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:04.776491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:04.777737 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ae47e1b9-5c17-44a3-a5e4-1b2b50b2f28e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1740 microversion: 2.20 time: 0.159812 Sep 09 15:03:04.778303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 369/745] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:04 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:05.381751 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-617cfbd8-24b2-4f8f-916e-cc962276c582 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:05.383869 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-617cfbd8-24b2-4f8f-916e-cc962276c582 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:05.391628 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-617cfbd8-24b2-4f8f-916e-cc962276c582 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:05.392105 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-617cfbd8-24b2-4f8f-916e-cc962276c582 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:05.392539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-617cfbd8-24b2-4f8f-916e-cc962276c582 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:05.393259 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-617cfbd8-24b2-4f8f-916e-cc962276c582 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:05.393709 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-617cfbd8-24b2-4f8f-916e-cc962276c582 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:05.394169 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-617cfbd8-24b2-4f8f-916e-cc962276c582 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:05.412227 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:05.427967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-617cfbd8-24b2-4f8f-916e-cc962276c582 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050090 Sep 09 15:03:05.428534 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 377/746] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:03:05 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:05.804136 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:05.804875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:05.811722 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:05.812206 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:05.812640 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:05.813362 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:05.813814 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:05.814267 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:05.958244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:05.970507 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:05.971957 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:05.973131 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-80a4462d-bf4b-4c09-9bfb-9499b3674daf tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1722 microversion: 2.20 time: 0.173619 Sep 09 15:03:05.974053 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 370/747] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:05 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:06.440081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a55d2b5-3624-48a2-9e8b-43764c02c1fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:06.442305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a55d2b5-3624-48a2-9e8b-43764c02c1fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:06.448903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a55d2b5-3624-48a2-9e8b-43764c02c1fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:06.449366 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a55d2b5-3624-48a2-9e8b-43764c02c1fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:06.449804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a55d2b5-3624-48a2-9e8b-43764c02c1fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:06.450497 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a55d2b5-3624-48a2-9e8b-43764c02c1fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:06.450949 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a55d2b5-3624-48a2-9e8b-43764c02c1fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:06.451376 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a55d2b5-3624-48a2-9e8b-43764c02c1fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:06.480957 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a55d2b5-3624-48a2-9e8b-43764c02c1fa tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044906 Sep 09 15:03:06.481548 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 378/748] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:03:06 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 15:03:06.544227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:06.544729 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:06.550624 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:06.551111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:06.551552 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:06.552250 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:06.552707 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:06.553136 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:06.578397 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:03:06.651521 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4aa644a3-4b8a-4753-b059-77424028ff3c tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 204 len: 0 microversion: 2.1 time: 0.110907 Sep 09 15:03:06.652127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 371/749] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:03:06 2022] DELETE /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:03:06.660599 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:06.661229 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:06.667167 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:06.667653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:06.668088 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:06.668775 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:06.669264 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:06.669691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:06.798128 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:06.805874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e786c199-6cfe-42f8-8e2e-4e5c9af5c09f tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1680 microversion: 2.1 time: 0.149115 Sep 09 15:03:06.806443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 379/750] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:06 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:07.000797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:07.001526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:07.007961 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:07.008446 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:07.008944 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:07.009661 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:07.010123 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:07.010544 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:07.141344 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:07.149654 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:07.151166 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:07.152398 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a71b05af-ec88-4ad7-8543-38346cdb5d9d tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1722 microversion: 2.20 time: 0.156801 Sep 09 15:03:07.152951 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 372/751] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:06 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:07.829717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:07.830328 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:07.836853 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:07.837307 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:07.837742 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:07.838456 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:07.838904 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:07.839323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:07.968992 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:07.980640 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0aa1adc9-ec8d-43fb-94f5-9dbd7bcc02e2 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1680 microversion: 2.1 time: 0.155005 Sep 09 15:03:07.981678 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 380/752] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:07 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:08.178344 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:08.178959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:08.185433 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:08.185920 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:08.186862 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:08.187544 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:08.188002 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:08.188425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:08.315040 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:08.323713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:08.325145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:08.326455 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-445dbd3a-273c-4b46-bfb7-5a13b03fdf4c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1722 microversion: 2.20 time: 0.152103 Sep 09 15:03:08.327730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 373/753] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:08 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:08.881628 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-797a6d28-aa94-489d-b3df-a47b6d4a159e req-3dc5fb06-992e-47c5-b610-4b82ae50beb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ac907a-c540-41ce-bcc5-3339348a221b", "name": "network-vif-unplugged", "status": "completed", "tag": "c8f3dda8-23ee-414a-9861-fbe66c356bcf"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:08.886848 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=80 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:08.892508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-797a6d28-aa94-489d-b3df-a47b6d4a159e req-3dc5fb06-992e-47c5-b610-4b82ae50beb3 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:08.892991 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-797a6d28-aa94-489d-b3df-a47b6d4a159e req-3dc5fb06-992e-47c5-b610-4b82ae50beb3 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:08.893449 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-797a6d28-aa94-489d-b3df-a47b6d4a159e req-3dc5fb06-992e-47c5-b610-4b82ae50beb3 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:08.904244 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-797a6d28-aa94-489d-b3df-a47b6d4a159e req-3dc5fb06-992e-47c5-b610-4b82ae50beb3 service nova] Creating event network-vif-unplugged:c8f3dda8-23ee-414a-9861-fbe66c356bcf for instance 23ac907a-c540-41ce-bcc5-3339348a221b on hv-cinder-82869 Sep 09 15:03:08.909916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-797a6d28-aa94-489d-b3df-a47b6d4a159e req-3dc5fb06-992e-47c5-b610-4b82ae50beb3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031927 Sep 09 15:03:08.910523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 381/754] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:09.007775 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:09.008325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:09.014516 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:09.015032 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:09.015471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:09.016176 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:09.016631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:09.017057 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:09.146170 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:09.153854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ebf57272-b144-4a4d-8371-2a463ebf1a6e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1680 microversion: 2.1 time: 0.150004 Sep 09 15:03:09.154429 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 374/755] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:09 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:09.354857 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:09.355551 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:09.361710 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:09.362195 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:09.362632 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:09.363316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:09.363765 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:09.364184 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:09.488880 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:09.496994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:09.498474 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:09.500132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7c9eef8-006a-4c70-bab6-52838cd00f11 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1722 microversion: 2.20 time: 0.149600 Sep 09 15:03:09.501063 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 382/756] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:09 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:03:10.178458 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:10.179250 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:10.181972 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:10.189082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:10.189795 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:10.190388 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:10.191203 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:10.191730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:10.192427 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:10.394798 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:10.402451 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-57fc44ca-0f69-4518-ba44-30ed35971a62 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1680 microversion: 2.1 time: 0.228078 Sep 09 15:03:10.403015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 375/757] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:10 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:10.526823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:10.527437 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:10.534622 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:10.535108 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:10.535546 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:10.536249 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:10.536701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:10.537124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:10.788776 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-5841947c-d921-4822-b57a-44319f6e89df req-c6420973-2ffa-4c4e-bb09-f05da2441f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4347b16f-4907-4b7a-b5e3-dc0b4e142116", "name": "network-vif-deleted", "tag": "34211ad4-de4c-4d6e-b4ff-f5d49198d966"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:10.797500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:10.814238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-5841947c-d921-4822-b57a-44319f6e89df req-c6420973-2ffa-4c4e-bb09-f05da2441f5f service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:10.815072 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-5841947c-d921-4822-b57a-44319f6e89df req-c6420973-2ffa-4c4e-bb09-f05da2441f5f service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:10.815608 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-5841947c-d921-4822-b57a-44319f6e89df req-c6420973-2ffa-4c4e-bb09-f05da2441f5f service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:10.819316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:10.820741 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:10.824183 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c0b6b69-8a0b-4202-b16b-27f657230e09 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1665 microversion: 2.20 time: 0.301313 Sep 09 15:03:10.825004 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 383/758] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:10 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1665 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:10.836042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-5841947c-d921-4822-b57a-44319f6e89df req-c6420973-2ffa-4c4e-bb09-f05da2441f5f service nova] Creating event network-vif-deleted:34211ad4-de4c-4d6e-b4ff-f5d49198d966 for instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 on hv-cinder-82869 Sep 09 15:03:10.841028 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-5841947c-d921-4822-b57a-44319f6e89df req-c6420973-2ffa-4c4e-bb09-f05da2441f5f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059767 Sep 09 15:03:10.849386 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 376/759] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:03:10.855613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2f2db33-cd6c-4035-8de2-ef8052133687 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a970255e-deaf-4619-aa3f-5f06be3617c2"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:10.858491 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2f2db33-cd6c-4035-8de2-ef8052133687 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:10.867920 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f2db33-cd6c-4035-8de2-ef8052133687 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:10.868783 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f2db33-cd6c-4035-8de2-ef8052133687 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:10.869527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f2db33-cd6c-4035-8de2-ef8052133687 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:10.877659 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f2db33-cd6c-4035-8de2-ef8052133687 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:10.878395 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f2db33-cd6c-4035-8de2-ef8052133687 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:10.879372 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2f2db33-cd6c-4035-8de2-ef8052133687 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.226709 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2f2db33-cd6c-4035-8de2-ef8052133687 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.379037 Sep 09 15:03:11.228627 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 384/760] 10.222.0.15 () {62 vars in 1364 bytes} [Fri Sep 9 15:03:10 2022] POST /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/os-volume_attachments => generated 188 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 15:03:11.402637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a0e6d1ec-f604-415d-808e-aa1433d46666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:11.404946 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a0e6d1ec-f604-415d-808e-aa1433d46666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:11.416227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e6d1ec-f604-415d-808e-aa1433d46666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:11.416759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e6d1ec-f604-415d-808e-aa1433d46666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:11.418019 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e6d1ec-f604-415d-808e-aa1433d46666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.419119 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e6d1ec-f604-415d-808e-aa1433d46666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:11.419579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e6d1ec-f604-415d-808e-aa1433d46666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:11.420043 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e6d1ec-f604-415d-808e-aa1433d46666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.427367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:11.427992 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:11.437340 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:11.438811 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:11.439455 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.440176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:11.440690 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:11.441070 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.477447 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:11.477989 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:11.478438 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.478890 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lazy-loading 'fault' on Instance uuid 4347b16f-4907-4b7a-b5e3-dc0b4e142116 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:03:11.542588 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770105b06e084179a819a54d28b70cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063bdf7448ee45939287687b0e65dd97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:11.550806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2fdef040-84b3-4e2d-8f74-3286ce9e1eb7 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 200 len: 1330 microversion: 2.1 time: 0.127648 Sep 09 15:03:11.567671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 385/761] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:11 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 1330 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:03:11.693892 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a0e6d1ec-f604-415d-808e-aa1433d46666 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "DELETE /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/os-volume_attachments/a970255e-deaf-4619-aa3f-5f06be3617c2" status: 202 len: 0 microversion: 2.20 time: 0.305917 Sep 09 15:03:11.694508 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 377/762] 10.222.0.15 () {60 vars in 1457 bytes} [Fri Sep 9 15:03:11 2022] DELETE /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/os-volume_attachments/a970255e-deaf-4619-aa3f-5f06be3617c2 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:03:11.756556 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:11.757148 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:11.763178 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:11.763662 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:11.764098 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.764789 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:11.765266 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:11.765692 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.796383 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120643) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 15:03:11.863798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e5c5cf3-1043-4558-9011-789fbe6273a0 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "POST /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/action" status: 202 len: 0 microversion: 2.20 time: 0.111173 Sep 09 15:03:11.864661 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 386/763] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Sep 9 15:03:11 2022] POST /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:03:11.872879 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:11.873629 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:11.880600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:11.881230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:11.881777 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.882581 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:11.883320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:11.883843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:11.889066 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:12.031030 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:12.042146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:12.043607 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:12.044792 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2bf015d1-92df-459e-a3d8-4d071f17ffef tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1673 microversion: 2.20 time: 0.176117 Sep 09 15:03:12.045378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 378/764] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:11 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:03:12.575297 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:12.576038 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:12.583903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:12.584404 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:12.584873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:12.585640 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:12.586394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:12.586856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:12.600886 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 HTTP/1.1 Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:03:12.602813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:12.604377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '4347b16f-4907-4b7a-b5e3-dc0b4e142116'} Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:12.605305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:12.607007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:12.609682 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:12.610743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ff374e3-8320-4836-bc46-f3db152c6362 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 404 len: 111 microversion: 2.1 time: 0.039350 Sep 09 15:03:12.611479 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 387/765] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:12 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:12.622911 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-de247835-cbbd-45d6-8825-897cc3f6a1de tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '.version_select at 0x7f8ad24b2af0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:12.651073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-de247835-cbbd-45d6-8825-897cc3f6a1de tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-766870601" status: 202 len: 0 microversion: 2.1 time: 0.034370 Sep 09 15:03:12.651894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 379/766] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Sep 9 15:03:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-766870601 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:03:13.070995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:13.071851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:13.078906 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:13.079387 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:13.079997 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:13.080870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:13.081500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:13.082583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:13.319190 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:13.327386 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:13.329008 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:13.330307 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee61be85-3d6a-49a9-82fa-f1ff1bb125ab tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.263191 Sep 09 15:03:13.330946 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 388/767] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:13 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:14.355734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:14.356342 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:14.364336 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:14.364817 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:14.365276 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:14.365964 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:14.366413 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:14.366834 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:14.499913 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:14.508065 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:14.509538 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:14.510709 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fead6813-7264-4706-b9d4-c79fc21cc548 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.158835 Sep 09 15:03:14.511268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 380/768] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:14 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:14.723060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:14.724124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:14.731550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:14.732255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:14.732856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:14.733767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:14.734641 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:14.735392 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:14.751015 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 HTTP/1.1 Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:03:14.753177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.754810 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '4347b16f-4907-4b7a-b5e3-dc0b4e142116'} Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:14.755713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.757073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.759464 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:14.760494 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7a3f5fb-2c5e-47e5-a9d3-aba96640e7c3 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 404 len: 111 microversion: 2.1 time: 0.042679 Sep 09 15:03:14.761645 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 389/769] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:03:14 2022] DELETE /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:14.769836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:14.770534 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 4347b16f-4907-4b7a-b5e3-dc0b4e142116] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:14.776947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:14.777544 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:14.778239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:14.779148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:14.779791 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:14.780747 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:14.799873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 HTTP/1.1 Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:03:14.802596 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.804178 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '4347b16f-4907-4b7a-b5e3-dc0b4e142116'} Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:14.805051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. Sep 09 15:03:14.806511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:14.809821 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 4347b16f-4907-4b7a-b5e3-dc0b4e142116 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:14.811292 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8106d287-2efa-4eb9-8eb3-980ca9a609db tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116" status: 404 len: 111 microversion: 2.1 time: 0.045661 Sep 09 15:03:14.813227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 381/770] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:14 2022] GET /compute/v2.1/servers/4347b16f-4907-4b7a-b5e3-dc0b4e142116 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:15.537659 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:15.538362 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:15.544529 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:15.544956 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:15.545431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:15.546131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:15.546590 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:15.547244 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:15.689318 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:15.706391 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:15.708651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:15.710426 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75deab0f-0438-420f-a008-e43f2dfbfe92 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.176729 Sep 09 15:03:15.711212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 390/771] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:15 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:15.988380 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:15.988902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:15.995426 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:15.995911 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:15.996353 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:15.997045 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:15.997534 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:15.997963 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:16.011887 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: DELETE /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b HTTP/1.1 Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:03:16.013483 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.014896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '58941584-8b16-4d54-91ca-6565820ed69b'} Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:16.015648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.016926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.019038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:16.019038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-76f216e6-6290-42a8-8b2d-5101eff96419 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 404 len: 111 microversion: 2.1 time: 0.031082 Sep 09 15:03:16.019038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 382/772] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:03:15 2022] DELETE /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:16.023795 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:16.024414 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 58941584-8b16-4d54-91ca-6565820ed69b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:16.031261 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:16.031750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:16.032190 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:16.032898 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:16.033391 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:16.033822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:16.047364 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b HTTP/1.1 Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:03:16.048916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.050468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '58941584-8b16-4d54-91ca-6565820ed69b'} Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:16.051296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. Sep 09 15:03:16.052510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.053640 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 58941584-8b16-4d54-91ca-6565820ed69b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:16.053640 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3097435-fd3e-4ec6-8284-cd6907362894 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b" status: 404 len: 111 microversion: 2.1 time: 0.030507 Sep 09 15:03:16.053640 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 391/773] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:16 2022] GET /compute/v2.1/servers/58941584-8b16-4d54-91ca-6565820ed69b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:16.058916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:16.059420 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:16.065897 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:16.066391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:16.066833 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:16.067530 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:16.067987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:16.068415 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:16.082845 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: DELETE /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 HTTP/1.1 Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:03:16.084647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.086161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '85d7f23b-6ebe-4a3a-9c5d-47a52df51a92'} Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:16.086876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.091464 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.092697 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:16.092697 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-11c64fc1-34da-4981-b3de-fdf8e6fe7197 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 404 len: 111 microversion: 2.1 time: 0.031974 Sep 09 15:03:16.092697 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 383/774] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:03:16 2022] DELETE /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:16.097137 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:16.098295 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:16.104679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:16.105441 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:16.106038 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:16.106939 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:16.107555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:16.108179 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:16.125834 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 HTTP/1.1 Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:03:16.127399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.128697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '85d7f23b-6ebe-4a3a-9c5d-47a52df51a92'} Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:16.129602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. Sep 09 15:03:16.130822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:16.131863 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:16.131863 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe98095b-adfd-42a7-8598-1af0d67fa737 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92" status: 404 len: 111 microversion: 2.1 time: 0.036721 Sep 09 15:03:16.131863 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 392/775] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:16 2022] GET /compute/v2.1/servers/85d7f23b-6ebe-4a3a-9c5d-47a52df51a92 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:16.737587 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:16.738170 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:16.744131 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:16.744618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:16.745060 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:16.745851 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:16.746313 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:16.746753 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:16.891725 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:16.899944 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:16.901416 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:16.902578 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d9c34c73-3b8e-4bab-b282-aa0226dc48cd tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.169094 Sep 09 15:03:16.903134 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 384/776] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:16 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:17.272995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:17.273495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:17.279856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:17.280602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:17.281042 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:17.281759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:17.282219 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:17.282644 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:17.295776 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 HTTP/1.1 Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:03:17.297584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.299754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '70c93a5b-944b-43a7-95f6-e49c229603b6'} Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:17.301075 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.303603 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.305665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:17.305665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3bf9b7a-34ce-431d-b599-f65ff5a1748e tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "DELETE /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 404 len: 111 microversion: 2.1 time: 0.030602 Sep 09 15:03:17.305665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 393/777] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:03:17 2022] DELETE /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:17.308983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:17.309650 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] [instance: 70c93a5b-944b-43a7-95f6-e49c229603b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:17.316573 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:17.317060 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:17.317546 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:17.318233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:17.318688 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:17.319109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:17.332858 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] HTTP exception thrown: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Request method failure captured: Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 HTTP/1.1 Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RThMKDuCQcnXRuGUarPUTBeNRAulZNbWviKGtyH7W8Ubu6Izj4u7wL5musuzfMg0sE7pQPYiQB73h9ZNjSlrgBPlU1q1NmSuXln5gMgnmdB6iYN2CCoz4gY6OobvWlGDVAamCXpP4mXVB-lkZjA7OKbPfa5xV9qNprkGxunDFOK5o Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:03:17.334625 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/063bdf7448ee45939287687b0e65dd97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_063bdf7448ee45939287687b0e65dd97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 063bdf7448ee45939287687b0e65dd97 Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1647360943 Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 770105b06e084179a819a54d28b70cdf Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-1647360943-project Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.336467 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '70c93a5b-944b-43a7-95f6-e49c229603b6'} Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:17.337185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. Sep 09 15:03:17.340011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:17.341064 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] Returning 404 to user: Instance 70c93a5b-944b-43a7-95f6-e49c229603b6 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:17.341064 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c155dbd2-e15e-42e7-8ecc-5bbe04966e61 tempest-AttachVolumeNegativeTest-1647360943 tempest-AttachVolumeNegativeTest-1647360943-project] 10.222.0.15 "GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6" status: 404 len: 111 microversion: 2.1 time: 0.030997 Sep 09 15:03:17.341480 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 385/778] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:17 2022] GET /compute/v2.1/servers/70c93a5b-944b-43a7-95f6-e49c229603b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:17.928520 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:17.929345 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:17.935335 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:17.935897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:17.936402 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:17.937218 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:17.937800 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:17.938292 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:17.942476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:18.212197 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:18.229507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:18.230947 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:18.232336 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7220daf0-3b04-414a-abbd-de7c1b512da7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.307778 Sep 09 15:03:18.250307 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 394/779] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:17 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:19.260191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:19.260822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:19.274745 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:19.275242 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:19.275870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:19.276779 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:19.277450 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:19.278039 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:19.538149 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:19.552747 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:19.554613 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:19.558200 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-549d30c3-1805-4330-afb0-e1f2b82edc66 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.302694 Sep 09 15:03:19.562165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 386/780] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:19 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:20.587039 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:20.587729 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:20.600956 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:20.604996 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:20.605677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:20.610839 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:20.611504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:20.612096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:20.874502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:20.893943 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:20.908019 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:20.909532 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d61595cf-1b51-4109-befb-e68aea2a58ed tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.327152 Sep 09 15:03:20.911499 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 395/781] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:20 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:21.940035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:21.940659 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:21.947130 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:21.947622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:21.948065 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:21.948774 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:21.949328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:21.949757 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:22.169805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:22.187207 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:22.189525 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:22.191295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-23e18ff7-a4d1-4c79-865c-ebd6978226d9 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.255719 Sep 09 15:03:22.212829 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 387/782] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:21 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:23.218651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:23.220528 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:23.228065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:23.228820 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:23.241601 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:23.242812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:23.243559 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:23.244059 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:23.388489 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:23.397129 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:23.398605 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:23.399759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48d2b95f-f54e-47a5-a828-16cba4f85afc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.185928 Sep 09 15:03:23.400332 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 396/783] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:23 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:24.425636 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:24.426442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:24.433606 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:24.434092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:24.434536 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:24.435236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:24.435697 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:24.436125 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:24.568512 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:24.576734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:24.579072 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:24.580280 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-09355613-be38-4476-94cc-c7657bba2c1f tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.159655 Sep 09 15:03:24.580841 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 388/784] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:24 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:25.606013 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:25.606630 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:25.613438 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:25.613928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:25.614377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:25.615079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:25.615537 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:25.615964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:25.751795 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:25.759960 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:25.761447 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:25.762907 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a37e5a98-cd41-4cd6-9d05-2e4da994e08e tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.160829 Sep 09 15:03:25.776306 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 397/785] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:25 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:26.789165 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:26.789800 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:26.799256 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:26.799711 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:26.800160 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:26.800858 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:26.801340 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:26.801777 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:26.942918 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:26.951856 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:26.953526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:26.954598 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cb93e5a7-8904-4fe1-8300-4d3c678780f1 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.169372 Sep 09 15:03:26.957233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 389/786] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:26 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:27.980736 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:27.982181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:27.989633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:27.990681 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:27.991289 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:27.992517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:27.993750 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:27.994273 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:28.310807 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:28.321079 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:28.323728 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:28.325558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a07b5de3-db0d-4d4a-96ba-63950e07da95 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.349053 Sep 09 15:03:28.326252 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 398/787] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:27 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:29.352370 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:29.353320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:29.360606 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:29.361287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:29.361615 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:29.363132 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:29.363132 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:29.363132 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:29.514968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:29.523593 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:29.525114 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:29.526498 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-322472e5-dc55-44f0-ae50-fd120f33e869 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.178531 Sep 09 15:03:29.527058 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 390/788] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:29 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:29.775427 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-1b6d0e56-e01d-46b6-a2ae-51c3cad5ea6e req-1516bed2-bd7b-47a1-a247-45827d932533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ac907a-c540-41ce-bcc5-3339348a221b", "name": "network-vif-plugged", "status": "completed", "tag": "c8f3dda8-23ee-414a-9861-fbe66c356bcf"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:29.788059 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1b6d0e56-e01d-46b6-a2ae-51c3cad5ea6e req-1516bed2-bd7b-47a1-a247-45827d932533 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:29.800204 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1b6d0e56-e01d-46b6-a2ae-51c3cad5ea6e req-1516bed2-bd7b-47a1-a247-45827d932533 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:29.800737 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1b6d0e56-e01d-46b6-a2ae-51c3cad5ea6e req-1516bed2-bd7b-47a1-a247-45827d932533 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:29.824344 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-1b6d0e56-e01d-46b6-a2ae-51c3cad5ea6e req-1516bed2-bd7b-47a1-a247-45827d932533 service nova] Creating event network-vif-plugged:c8f3dda8-23ee-414a-9861-fbe66c356bcf for instance 23ac907a-c540-41ce-bcc5-3339348a221b on hv-cinder-82869 Sep 09 15:03:29.830746 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-1b6d0e56-e01d-46b6-a2ae-51c3cad5ea6e req-1516bed2-bd7b-47a1-a247-45827d932533 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059716 Sep 09 15:03:29.831617 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 399/789] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:30.551953 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:30.552588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:30.559051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:30.559534 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:30.559968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:30.560683 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:30.561137 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:30.561591 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:30.849880 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:30.858128 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:30.860481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:30.861924 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-129bf205-e40d-42cc-9892-a5e8ec1aa0b7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.313942 Sep 09 15:03:30.862485 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 391/790] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:30 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:31.889137 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:31.889870 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:31.896490 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:31.896976 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:31.897442 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:31.898131 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:31.898600 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:31.899011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:32.041937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:32.050399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:32.052511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:32.053708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8db9c924-38ed-4611-b2fc-368433810168 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1731 microversion: 2.20 time: 0.169318 Sep 09 15:03:32.054445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 400/791] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:31 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:33.080462 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:33.081071 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:33.087456 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:33.087968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:33.088399 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:33.089087 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:33.089563 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:33.089987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:33.227631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:33.237353 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:33.238785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:33.239971 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-514656df-7c8a-4481-8126-00e246ad61bc tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1718 microversion: 2.20 time: 0.164075 Sep 09 15:03:33.240515 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 392/792] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:03:33 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:03:40.490746 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c055d3e-e5ba-4585-81c1-1dbcdf2f8353 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:40.491250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c055d3e-e5ba-4585-81c1-1dbcdf2f8353 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:40.494504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:40.498887 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c055d3e-e5ba-4585-81c1-1dbcdf2f8353 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:40.499383 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c055d3e-e5ba-4585-81c1-1dbcdf2f8353 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:40.500343 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c055d3e-e5ba-4585-81c1-1dbcdf2f8353 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:40.501120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c055d3e-e5ba-4585-81c1-1dbcdf2f8353 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:40.501604 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c055d3e-e5ba-4585-81c1-1dbcdf2f8353 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:40.502491 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c055d3e-e5ba-4585-81c1-1dbcdf2f8353 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:40.529168 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c055d3e-e5ba-4585-81c1-1dbcdf2f8353 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/ips" status: 200 len: 146 microversion: 2.1 time: 0.247781 Sep 09 15:03:40.529867 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 401/793] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 15:03:40 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/ips => generated 146 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:41.909623 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8ecae7da-0da1-426c-bc61-17adfaa6e86d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f857327-d2f3-4b37-a127-ca90037f7505"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:41.911971 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8ecae7da-0da1-426c-bc61-17adfaa6e86d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:41.917875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:41.919327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ecae7da-0da1-426c-bc61-17adfaa6e86d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:41.919822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ecae7da-0da1-426c-bc61-17adfaa6e86d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:41.920265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ecae7da-0da1-426c-bc61-17adfaa6e86d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:41.920979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ecae7da-0da1-426c-bc61-17adfaa6e86d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:41.921468 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ecae7da-0da1-426c-bc61-17adfaa6e86d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:41.921939 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ecae7da-0da1-426c-bc61-17adfaa6e86d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:41.927506 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=68 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:42.222475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8ecae7da-0da1-426c-bc61-17adfaa6e86d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317624 Sep 09 15:03:42.223207 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 393/794] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:03:41 2022] POST /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:03:48.288648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:48.289327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:48.295705 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:48.296194 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:48.296638 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:48.297371 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:48.297833 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:48.298262 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:48.300815 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=41 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:48.323694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:03:48.399114 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1440dc6-bf5c-4417-86fb-533953735e59 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 204 len: 0 microversion: 2.1 time: 0.114066 Sep 09 15:03:48.399798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 402/795] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:03:48 2022] DELETE /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:03:48.410295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:48.411015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:48.417645 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:48.418148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:48.418595 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:48.419309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:48.419772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:48.420204 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:48.568649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:48.576605 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f0e858e-6ab0-4f61-81cf-d8b26537bd08 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1576 microversion: 2.1 time: 0.172361 Sep 09 15:03:48.577271 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 394/796] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:48 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:49.601298 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:49.601922 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:49.608299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:49.608789 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:49.609256 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:49.609947 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:49.610403 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:49.610831 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:49.750134 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:49.757931 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d12af6ad-e17e-4081-b1a7-b2b877e3c30d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1576 microversion: 2.1 time: 0.160935 Sep 09 15:03:49.758563 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 403/797] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:49 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:50.782526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:50.783149 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:50.789623 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:50.790129 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:50.790566 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:50.791253 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:50.791881 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:50.792308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:50.863545 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c15c68ba-5ee6-41ed-b40b-5a8ca19e1690 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:50.865844 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c15c68ba-5ee6-41ed-b40b-5a8ca19e1690 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:50.872421 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c68ba-5ee6-41ed-b40b-5a8ca19e1690 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:50.872893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c68ba-5ee6-41ed-b40b-5a8ca19e1690 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:50.873378 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c68ba-5ee6-41ed-b40b-5a8ca19e1690 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:50.874072 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c68ba-5ee6-41ed-b40b-5a8ca19e1690 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:50.874540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c68ba-5ee6-41ed-b40b-5a8ca19e1690 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:50.874958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c68ba-5ee6-41ed-b40b-5a8ca19e1690 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:50.908504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c15c68ba-5ee6-41ed-b40b-5a8ca19e1690 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049531 Sep 09 15:03:50.909061 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 404/798] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:03:50 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:50.920189 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-335b174d-4552-496b-8d36-41a7b5726dc9 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:50.920687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-335b174d-4552-496b-8d36-41a7b5726dc9 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:50.928455 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-335b174d-4552-496b-8d36-41a7b5726dc9 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:50.928946 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-335b174d-4552-496b-8d36-41a7b5726dc9 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:50.929433 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-335b174d-4552-496b-8d36-41a7b5726dc9 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:50.930138 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-335b174d-4552-496b-8d36-41a7b5726dc9 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:50.930592 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-335b174d-4552-496b-8d36-41a7b5726dc9 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:50.931018 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-335b174d-4552-496b-8d36-41a7b5726dc9 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:50.966183 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-335b174d-4552-496b-8d36-41a7b5726dc9 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/1f857327-d2f3-4b37-a127-ca90037f7505" status: 200 len: 194 microversion: 2.1 time: 0.049424 Sep 09 15:03:50.967660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 405/799] 10.222.0.15 () {58 vars in 1413 bytes} [Fri Sep 9 15:03:50 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/1f857327-d2f3-4b37-a127-ca90037f7505 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:51.042024 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:51.050558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7605ea25-0531-4c48-92b6-93465ee5ae28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1576 microversion: 2.1 time: 0.273318 Sep 09 15:03:51.051129 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 395/800] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:50 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1576 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:51.429368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-57ed6d7e-872c-4f65-bebe-ea5add980260 req-3701fc31-1596-4657-aeab-78143412f68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffad6426-5a0d-4119-9cd7-c60407cc7972", "name": "network-vif-deleted", "tag": "8c96acd7-4922-4cce-9604-cfd8b94ada60"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:51.442003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-57ed6d7e-872c-4f65-bebe-ea5add980260 req-3701fc31-1596-4657-aeab-78143412f68a service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:51.442388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-57ed6d7e-872c-4f65-bebe-ea5add980260 req-3701fc31-1596-4657-aeab-78143412f68a service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:51.442816 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-57ed6d7e-872c-4f65-bebe-ea5add980260 req-3701fc31-1596-4657-aeab-78143412f68a service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:51.456630 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-57ed6d7e-872c-4f65-bebe-ea5add980260 req-3701fc31-1596-4657-aeab-78143412f68a service nova] Creating event network-vif-deleted:8c96acd7-4922-4cce-9604-cfd8b94ada60 for instance ffad6426-5a0d-4119-9cd7-c60407cc7972 on hv-cinder-82869 Sep 09 15:03:51.462799 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-57ed6d7e-872c-4f65-bebe-ea5add980260 req-3701fc31-1596-4657-aeab-78143412f68a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037956 Sep 09 15:03:51.463396 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 406/801] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:52.075472 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:52.077455 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:52.087901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:52.088681 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:52.089415 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:52.090698 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:52.091521 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:52.092239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:52.149077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:52.150087 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:52.150904 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:52.151719 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lazy-loading 'fault' on Instance uuid ffad6426-5a0d-4119-9cd7-c60407cc7972 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:03:52.215241 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:52.226491 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5ff45d77-15f2-4979-bb8e-90d5dd1e411d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 200 len: 1229 microversion: 2.1 time: 0.156279 Sep 09 15:03:52.227215 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 396/802] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:52 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 1229 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:52.331257 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd70890b-b6dc-481a-928d-c8d2f47fbda4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71f0a9cb-3ffd-405c-83bb-9eb9e9b2e215"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:52.334375 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd70890b-b6dc-481a-928d-c8d2f47fbda4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:52.342326 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70890b-b6dc-481a-928d-c8d2f47fbda4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:52.343125 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70890b-b6dc-481a-928d-c8d2f47fbda4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:52.343788 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70890b-b6dc-481a-928d-c8d2f47fbda4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:52.345306 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70890b-b6dc-481a-928d-c8d2f47fbda4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:52.345988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70890b-b6dc-481a-928d-c8d2f47fbda4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:52.346607 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70890b-b6dc-481a-928d-c8d2f47fbda4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:52.659054 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd70890b-b6dc-481a-928d-c8d2f47fbda4 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "POST /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331954 Sep 09 15:03:52.659937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 407/803] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:03:52 2022] POST /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:53.251484 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:53.253166 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:53.260019 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:53.260506 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:53.261133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:53.261882 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:53.262896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:53.263300 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:53.278707 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] HTTP exception thrown: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Request method failure captured: Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 HTTP/1.1 Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1UsZxE_48khTRIo_vdRab-4obgYjM0XRBX6EQx6g8XpIxEu0EFcPBga0AVgLyluKvsWLNhG8eGi7hipCB9nWvGu4UCDadpSAuNbsu3OwVfFJei6IhiBhk7GCahmWjgULqQeXRMUO-RNNQpDynLAE3_idjFD2b-0XKBslng9QWAKZ10 Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:03:53.280328 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_515d1ca3dcd249ada56b21a0a6e3a5b9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 9a50fbbf18584bb1a784283e768be7a2 Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:03:53.282220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': 'ffad6426-5a0d-4119-9cd7-c60407cc7972'} Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:03:53.283212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:03:53.284759 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:03:53.286181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Returning 404 to user: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:03:53.286181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-431d61b1-ee9e-41e6-b2a5-f9818ca28e17 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 404 len: 111 microversion: 2.1 time: 0.036005 Sep 09 15:03:53.286181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 397/804] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:53 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:03:53.461347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1864227535", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-845692317", "security_groups": [{"name": "tempest-secgroup-smoke-796642502"}], "block_device_mapping_v2": [{"uuid": "92d92f58-232e-4084-a4ae-eeb476a7e005", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "20d1d01f-8d2e-4d86-913d-da4da3df92d5"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:53.589000 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] validate_networks() for [('20d1d01f-8d2e-4d86-913d-da4da3df92d5', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:03:54.044394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:03:54.045111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:03:54.045883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:03:54.046370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:03:54.046772 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:03:54.057514 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:54.058699 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:54.058699 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:54.059491 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:54.059944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:54.060398 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:54.082815 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Getting quotas for project 515d1ca3dcd249ada56b21a0a6e3a5b9. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:03:54.088166 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Getting quotas for user 9a50fbbf18584bb1a784283e768be7a2 and project 515d1ca3dcd249ada56b21a0a6e3a5b9. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:03:54.152529 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:03:54.154979 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92d92f58-232e-4084-a4ae-eeb476a7e005',volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:03:54.325104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a237026-7bbc-4c99-892c-f28f647ef082 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.870277 Sep 09 15:03:54.325888 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 408/805] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:03:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 15:03:54.338197 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-feef7755-536f-47b4-8b2e-7aba6c029c83 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:54.339399 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-feef7755-536f-47b4-8b2e-7aba6c029c83 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:54.397079 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-feef7755-536f-47b4-8b2e-7aba6c029c83 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:54.405311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-feef7755-536f-47b4-8b2e-7aba6c029c83 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1094 microversion: 2.1 time: 0.071263 Sep 09 15:03:54.406335 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 398/806] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:54 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:55.430134 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:55.430739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:55.437177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:55.437701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:55.438135 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:55.439047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:55.439544 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:55.440136 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:55.585923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:55.595585 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c79e0c3-ff8f-4a34-b47d-f3de5b1b8b19 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1200 microversion: 2.1 time: 0.169299 Sep 09 15:03:55.596225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 409/807] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:55 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1200 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:56.620134 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:56.620980 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:56.637222 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:56.637861 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:56.638409 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:56.639387 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:56.639968 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:56.640632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:56.928728 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:56.943542 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d8cb8e8-a2ba-4d20-9acc-7ff14e2c1848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1277 microversion: 2.1 time: 0.328500 Sep 09 15:03:56.944137 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 399/808] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:56 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:57.341390 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-e690b7e4-ca89-499d-b367-6a4e39ada65c req-d8364665-f33d-4dbd-8110-39e4a82fee73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc366a9-fbb3-4d0c-a66f-05263ec7fadf", "tag": "cdbce435-f10d-40e7-9b00-ad1252f28480"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:03:57.356278 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e690b7e4-ca89-499d-b367-6a4e39ada65c req-d8364665-f33d-4dbd-8110-39e4a82fee73 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:57.356964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e690b7e4-ca89-499d-b367-6a4e39ada65c req-d8364665-f33d-4dbd-8110-39e4a82fee73 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:57.357790 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e690b7e4-ca89-499d-b367-6a4e39ada65c req-d8364665-f33d-4dbd-8110-39e4a82fee73 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:57.385502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-e690b7e4-ca89-499d-b367-6a4e39ada65c req-d8364665-f33d-4dbd-8110-39e4a82fee73 service nova] Creating event network-changed:cdbce435-f10d-40e7-9b00-ad1252f28480 for instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf on hv-cinder-82869 Sep 09 15:03:57.395658 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-e690b7e4-ca89-499d-b367-6a4e39ada65c req-d8364665-f33d-4dbd-8110-39e4a82fee73 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066768 Sep 09 15:03:57.396511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 410/809] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:03:57.969965 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:57.971239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:57.981761 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:57.982730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:57.983177 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:57.984548 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:57.986101 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:57.987197 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:58.221913 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:58.231139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28b8a6cf-5ca1-494b-90b6-6c6ada6791c2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1277 microversion: 2.1 time: 0.267039 Sep 09 15:03:58.231901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 400/810] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:57 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:03:59.256241 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:03:59.256991 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:03:59.262939 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:59.263481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:59.263850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:59.264531 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:03:59.268799 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:03:59.268799 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:03:59.402584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:03:59.410555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8883837e-0921-4384-92d2-bee581839a28 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1277 microversion: 2.1 time: 0.159639 Sep 09 15:03:59.411119 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 411/811] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:03:59 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:00.433893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:00.434557 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:00.441519 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:00.442006 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:00.442446 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:00.443137 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:00.443589 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:00.444013 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:00.574320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:00.582443 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b0a5d8ca-e577-4d20-886a-0e414344e7c4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1277 microversion: 2.1 time: 0.152494 Sep 09 15:04:00.582996 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 401/812] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:00 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:01.606983 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:01.607580 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:01.614095 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:01.614571 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:01.615017 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:01.615703 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:01.616137 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:01.616555 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:01.764089 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:01.772288 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-07f2be73-0ff9-48b8-a770-cfc77e53c3e1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1277 microversion: 2.1 time: 0.169236 Sep 09 15:04:01.773311 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 412/813] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:01 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:02.403749 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d32aabc1-697a-4aa6-bc4d-6310582fab31 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:02.406410 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d32aabc1-697a-4aa6-bc4d-6310582fab31 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:02.413332 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d32aabc1-697a-4aa6-bc4d-6310582fab31 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:02.413824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d32aabc1-697a-4aa6-bc4d-6310582fab31 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:02.414269 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d32aabc1-697a-4aa6-bc4d-6310582fab31 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:02.414973 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d32aabc1-697a-4aa6-bc4d-6310582fab31 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:02.415431 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d32aabc1-697a-4aa6-bc4d-6310582fab31 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:02.415864 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d32aabc1-697a-4aa6-bc4d-6310582fab31 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:02.446279 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d32aabc1-697a-4aa6-bc4d-6310582fab31 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046416 Sep 09 15:04:02.446767 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 402/814] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:04:02 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:02.583466 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa4e7012-4434-41ef-82da-00cf6b7afa22 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:02.583953 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa4e7012-4434-41ef-82da-00cf6b7afa22 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:02.592096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4e7012-4434-41ef-82da-00cf6b7afa22 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:02.592552 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4e7012-4434-41ef-82da-00cf6b7afa22 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:02.592988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4e7012-4434-41ef-82da-00cf6b7afa22 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:02.593723 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4e7012-4434-41ef-82da-00cf6b7afa22 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:02.594175 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4e7012-4434-41ef-82da-00cf6b7afa22 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:02.594595 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa4e7012-4434-41ef-82da-00cf6b7afa22 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:02.624628 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa4e7012-4434-41ef-82da-00cf6b7afa22 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/1f857327-d2f3-4b37-a127-ca90037f7505" status: 200 len: 194 microversion: 2.1 time: 0.045172 Sep 09 15:04:02.625273 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 413/815] 10.222.0.15 () {58 vars in 1413 bytes} [Fri Sep 9 15:04:02 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/1f857327-d2f3-4b37-a127-ca90037f7505 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:02.636349 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:02.636844 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:02.642799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:02.643285 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:02.643730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:02.644421 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:02.644880 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:02.645333 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:02.725713 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lazy-loading 'services' on Instance uuid 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:04:02.796017 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1efef3e8-3b8d-40a6-b231-c5ea7de583c6 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/1f857327-d2f3-4b37-a127-ca90037f7505" status: 202 len: 0 microversion: 2.1 time: 0.163558 Sep 09 15:04:02.796691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 403/816] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:04:02 2022] DELETE /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/1f857327-d2f3-4b37-a127-ca90037f7505 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:04:02.800303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:02.800303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:02.806990 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:02.807484 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:02.807916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:02.808607 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:02.809254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:02.809677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:02.961329 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:02.970521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41f8608d-77a7-4a8a-ac29-3fcbf2395c01 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1265 microversion: 2.1 time: 0.177688 Sep 09 15:04:02.971097 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 414/817] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:02 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:04:03.996622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:03.997432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:04.005244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:04.005808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:04.006468 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:04.007174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:04.007641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:04.008078 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:04.089003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2740de71-4aa4-421b-b636-46da9108852d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:04.089608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2740de71-4aa4-421b-b636-46da9108852d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:04.092181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:04.096730 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:04.099261 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2740de71-4aa4-421b-b636-46da9108852d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:04.099768 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2740de71-4aa4-421b-b636-46da9108852d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:04.100538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2740de71-4aa4-421b-b636-46da9108852d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:04.101281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2740de71-4aa4-421b-b636-46da9108852d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:04.101742 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2740de71-4aa4-421b-b636-46da9108852d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:04.102168 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2740de71-4aa4-421b-b636-46da9108852d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:04.137335 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2740de71-4aa4-421b-b636-46da9108852d tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/71f0a9cb-3ffd-405c-83bb-9eb9e9b2e215" status: 200 len: 194 microversion: 2.1 time: 0.052146 Sep 09 15:04:04.137957 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 415/818] 10.222.0.15 () {58 vars in 1413 bytes} [Fri Sep 9 15:04:04 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/71f0a9cb-3ffd-405c-83bb-9eb9e9b2e215 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:04.149511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:04.150015 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:04.157454 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:04.158665 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:04.159966 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:04.160972 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:04.161646 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:04.162274 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:04.189550 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:04.198188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9b0062af-682d-4259-9ed0-ea562e557070 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1265 microversion: 2.1 time: 0.207313 Sep 09 15:04:04.198777 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 404/819] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:03 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:04.270158 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lazy-loading 'services' on Instance uuid 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:04:04.512143 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fdc89bed-ac13-405a-b977-dcae9484ecdb tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/71f0a9cb-3ffd-405c-83bb-9eb9e9b2e215" status: 202 len: 0 microversion: 2.1 time: 0.366960 Sep 09 15:04:04.512928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 416/820] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:04:04 2022] DELETE /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments/71f0a9cb-3ffd-405c-83bb-9eb9e9b2e215 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 15:04:05.225895 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:05.226952 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:05.228940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:05.236008 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:05.236510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:05.236957 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:05.237694 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:05.238154 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:05.238583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:05.384056 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:05.392311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-305982c0-63c5-4190-b10b-f8d1190e26e8 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1265 microversion: 2.1 time: 0.172013 Sep 09 15:04:05.392888 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 405/821] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:05 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:05.701096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b7465e5-c3c5-4436-8958-c0bc2c4d4238 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:05.703308 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b7465e5-c3c5-4436-8958-c0bc2c4d4238 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:05.709345 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7465e5-c3c5-4436-8958-c0bc2c4d4238 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:05.709830 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7465e5-c3c5-4436-8958-c0bc2c4d4238 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:05.710258 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7465e5-c3c5-4436-8958-c0bc2c4d4238 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:05.710944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7465e5-c3c5-4436-8958-c0bc2c4d4238 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:05.711821 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7465e5-c3c5-4436-8958-c0bc2c4d4238 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:05.712206 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7465e5-c3c5-4436-8958-c0bc2c4d4238 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:05.717267 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:05.746863 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b7465e5-c3c5-4436-8958-c0bc2c4d4238 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050344 Sep 09 15:04:05.747574 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 417/822] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:04:05 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 15:04:05.872511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed6b814c-4aa8-4a46-b23d-6d7ca8caa521 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:05.874824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed6b814c-4aa8-4a46-b23d-6d7ca8caa521 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:05.880622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6b814c-4aa8-4a46-b23d-6d7ca8caa521 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:05.881109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6b814c-4aa8-4a46-b23d-6d7ca8caa521 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:05.881580 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6b814c-4aa8-4a46-b23d-6d7ca8caa521 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:05.882306 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6b814c-4aa8-4a46-b23d-6d7ca8caa521 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:05.882765 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6b814c-4aa8-4a46-b23d-6d7ca8caa521 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:05.883194 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6b814c-4aa8-4a46-b23d-6d7ca8caa521 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:05.912594 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed6b814c-4aa8-4a46-b23d-6d7ca8caa521 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044101 Sep 09 15:04:05.913239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 406/823] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:04:05 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 15:04:05.979800 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:05.980301 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:05.986753 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:05.987246 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:05.987687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:05.988383 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:05.988839 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:05.989297 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.014747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:04:06.097673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe33c787-8637-43c6-9e03-87603d94ea49 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 204 len: 0 microversion: 2.1 time: 0.121350 Sep 09 15:04:06.098504 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 418/824] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:04:05 2022] DELETE /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:04:06.106471 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:06.107060 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:06.113152 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.113689 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.114155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.114856 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.115317 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.115744 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.260152 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:06.268325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c7d4424-87bc-467b-95db-9b1bb10f37f0 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1674 microversion: 2.1 time: 0.165799 Sep 09 15:04:06.268891 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 407/825] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:06 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:06.409883 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-474a9fd9-86df-4e64-b6be-3a447a7a3f5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:06.412143 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-474a9fd9-86df-4e64-b6be-3a447a7a3f5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:06.414853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:06.415488 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:06.418598 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474a9fd9-86df-4e64-b6be-3a447a7a3f5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.419724 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474a9fd9-86df-4e64-b6be-3a447a7a3f5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.420388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474a9fd9-86df-4e64-b6be-3a447a7a3f5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.421335 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.421481 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474a9fd9-86df-4e64-b6be-3a447a7a3f5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.421792 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474a9fd9-86df-4e64-b6be-3a447a7a3f5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.421902 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.422219 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474a9fd9-86df-4e64-b6be-3a447a7a3f5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.422324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.422912 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.423590 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.424016 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.452933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-474a9fd9-86df-4e64-b6be-3a447a7a3f5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048430 Sep 09 15:04:06.453524 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 419/826] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 15:04:06 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:06.524074 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:06.524795 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:06.532098 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.532608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.533048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.534139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.534852 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.535326 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.562217 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:06.562971 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:04:06.570940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6a50f1cb-43f2-4e86-ab56-fa931871deb2 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1265 microversion: 2.1 time: 0.159786 Sep 09 15:04:06.571497 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 408/827] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:06 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:04:06.647711 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-506c3148-701a-4de4-a012-8512732ef763 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "DELETE /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 204 len: 0 microversion: 2.20 time: 0.127777 Sep 09 15:04:06.648299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 420/828] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Sep 9 15:04:06 2022] DELETE /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 15:04:06.657068 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:06.657762 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:06.663993 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.664482 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.664926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.665655 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:06.666117 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:06.666547 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:06.670515 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:06.802114 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:06.810539 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:06.812146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:06.813481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ef96be4-d717-4011-b600-49e994fbc749 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.160592 Sep 09 15:04:06.814669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 409/829] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:04:06 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:04:07.292497 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:07.293212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:07.300298 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:07.300884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:07.301455 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:07.302159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:07.302614 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:07.303041 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:07.438861 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:07.446970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a1c2f89-aa7c-45b7-9a68-39c086d1e201 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1674 microversion: 2.1 time: 0.158811 Sep 09 15:04:07.447540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 421/830] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:07 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:07.594914 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:07.596370 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:07.603501 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:07.603977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:07.604432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:07.605158 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:07.605624 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:07.606080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:07.749344 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:07.757955 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7034b81e-2cd6-4fdd-8af3-508aefd6c3f9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1265 microversion: 2.1 time: 0.167085 Sep 09 15:04:07.758592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 410/831] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:07 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:07.840863 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:07.841981 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:07.850607 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:07.851125 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:07.851577 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:07.852241 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:07.852696 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:07.853116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:07.989744 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:07.998769 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:08.000747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:08.002473 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c4ad21c-0a23-4ace-a8fc-61cf15e3b92c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.166346 Sep 09 15:04:08.003021 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 422/832] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:04:07 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:04:08.470006 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:08.470667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:08.476573 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:08.477061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:08.477539 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:08.478233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:08.478696 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:08.479127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:08.618548 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:08.626303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ab33222-5c24-475b-a045-745c2030d5d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1674 microversion: 2.1 time: 0.160209 Sep 09 15:04:08.627450 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 411/833] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:08 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:08.781110 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:08.781767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:08.788570 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:08.789054 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:08.789521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:08.790205 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:08.790658 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:08.791081 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:08.957585 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:08.965163 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7a21fe4-c41a-4677-ad3e-5818c5654a38 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1265 microversion: 2.1 time: 0.188265 Sep 09 15:04:08.965743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 423/834] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:08 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:09.028647 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:09.029280 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:09.036044 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:09.036520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:09.036956 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:09.037667 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:09.041550 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:09.041550 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:09.174644 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:09.182730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:09.184269 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:09.185457 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2b5d6b02-7ab1-4a11-a392-e79ff3192ce7 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.160679 Sep 09 15:04:09.186004 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 412/835] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:04:09 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 15:04:09.650926 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:09.651568 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:09.657966 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:09.658659 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:09.659097 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:09.659876 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:09.660252 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:09.660874 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:09.988334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:09.989052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:09.996327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:09.997782 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:09.998244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:09.998977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:09.999447 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:10.000273 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:10.020524 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:10.031141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a03b89b1-1239-4c5a-b829-3b6a58d2d522 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1674 microversion: 2.1 time: 0.384995 Sep 09 15:04:10.034990 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 424/836] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:09 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1674 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:10.216604 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:10.217342 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:10.226937 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:10.227464 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:10.227905 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:10.228615 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:10.229304 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:10.229682 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:10.414112 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:10.422807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7fd7ec81-4c1e-4ed6-bd88-3dc5b659ffe5 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1265 microversion: 2.1 time: 0.438775 Sep 09 15:04:10.424059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 413/837] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:09 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1265 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:04:10.540360 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:10.550199 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:10.551796 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:10.553072 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4c2d0a5-130c-41ee-b451-62bc6dd490f5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1724 microversion: 2.20 time: 0.344372 Sep 09 15:04:10.553752 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 425/838] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:04:10 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:04:11.058557 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:11.059312 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:11.067632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:11.068208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:11.068740 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:11.069548 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:11.070074 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:11.070566 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:11.183617 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72887db5ed34dbebe0d5745cf77c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498d32cc51a4bad9cb21e58985ce63e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:11.193071 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6006c41f-7f99-4eb9-a553-20ca59b2ad6f tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 200 len: 1606 microversion: 2.1 time: 0.138247 Sep 09 15:04:11.194198 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 414/839] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:11 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 1606 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:11.316917 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-6d17564f-cba5-41a1-8ca2-173112585f27 req-9f924b49-f227-406b-8fd2-ee2739e62c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704266ae-9ec2-45f2-b2ca-f5e6dcb07d76", "name": "network-vif-deleted", "tag": "0f8216ec-5fd2-4d42-9e5c-1ff97e0dd9a3"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:11.323129 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:11.345371 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6d17564f-cba5-41a1-8ca2-173112585f27 req-9f924b49-f227-406b-8fd2-ee2739e62c83 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:11.349653 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6d17564f-cba5-41a1-8ca2-173112585f27 req-9f924b49-f227-406b-8fd2-ee2739e62c83 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:11.354097 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6d17564f-cba5-41a1-8ca2-173112585f27 req-9f924b49-f227-406b-8fd2-ee2739e62c83 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:11.419104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-6d17564f-cba5-41a1-8ca2-173112585f27 req-9f924b49-f227-406b-8fd2-ee2739e62c83 service nova] Creating event network-vif-deleted:0f8216ec-5fd2-4d42-9e5c-1ff97e0dd9a3 for instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 on hv-cinder-82869 Sep 09 15:04:11.433754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-6d17564f-cba5-41a1-8ca2-173112585f27 req-9f924b49-f227-406b-8fd2-ee2739e62c83 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122842 Sep 09 15:04:11.436713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 426/840] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:11.448288 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:11.449316 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:11.467093 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:11.467610 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:11.470979 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:11.484126 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:11.487080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:11.487806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:11.581842 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:11.584065 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:11.606315 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:11.607837 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:11.610312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:11.612586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:11.613281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:11.616012 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:11.738239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:11.738729 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:11.750841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:11.753271 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c0c848f7858486c91773b34047d8aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83910e3ac2f4c8f9f127ab767bffd1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:11.754743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42d7e106-0f48-46d2-9cde-6bb8f27593c5 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 200 len: 1366 microversion: 2.20 time: 0.178811 Sep 09 15:04:11.755478 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 427/841] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:04:11 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 15:04:11.758456 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7e9c658f-bb1d-4ed3-b464-a35a30c584a3 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1265 microversion: 2.1 time: 0.315922 Sep 09 15:04:11.769806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 415/842] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:11 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:12.221485 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:12.222436 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:12.231866 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:12.232416 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:12.233047 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:12.233818 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:12.234308 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:12.234912 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:12.249420 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] HTTP exception thrown: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Request method failure captured: Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 HTTP/1.1 Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1SW0dKu4KuzbnPGsDtvvComdLr7ClzAHVdlz08McaP_r0GzBkzJZrOFMyZymH0SNDhzKI8znucj8Os7HOt2MW7t2jcFJrkwUS6jOzQkRmWOAe7-QQ_Z2VwtcR6OONdyfrVy3CDJuBMjzs4hJf5U9kvXsnvjR22xd4xt-HSC8pHK0Xs Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:04:12.251323 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e498d32cc51a4bad9cb21e58985ce63e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: b72887db5ed34dbebe0d5745cf77c4a8 Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:12.253003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '704266ae-9ec2-45f2-b2ca-f5e6dcb07d76'} Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:12.253910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:12.255350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.257786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Returning 404 to user: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:12.257786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-359ab97f-7b1c-4658-a218-fe50e46e24d8 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 404 len: 111 microversion: 2.1 time: 0.037584 Sep 09 15:04:12.257786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 428/843] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:12 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:04:12.262579 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ea843e46-be88-48f1-ae32-cb97f8becc83 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '.version_select at 0x7f8ad2682b80>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:12.271322 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=50 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:12.286832 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ea843e46-be88-48f1-ae32-cb97f8becc83 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703884082" status: 202 len: 0 microversion: 2.1 time: 0.028041 Sep 09 15:04:12.291135 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 416/844] 10.222.0.15 () {58 vars in 1221 bytes} [Fri Sep 9 15:04:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703884082 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:04:12.468495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-098a1333-a022-48af-97bd-4b6e36bc09ed req-fe57c107-90a6-4a13-b463-96d7e030c89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc366a9-fbb3-4d0c-a66f-05263ec7fadf", "name": "network-vif-plugged", "status": "completed", "tag": "cdbce435-f10d-40e7-9b00-ad1252f28480"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:12.491216 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-098a1333-a022-48af-97bd-4b6e36bc09ed req-fe57c107-90a6-4a13-b463-96d7e030c89d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:12.491742 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-098a1333-a022-48af-97bd-4b6e36bc09ed req-fe57c107-90a6-4a13-b463-96d7e030c89d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:12.492420 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-098a1333-a022-48af-97bd-4b6e36bc09ed req-fe57c107-90a6-4a13-b463-96d7e030c89d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:12.505685 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-098a1333-a022-48af-97bd-4b6e36bc09ed req-fe57c107-90a6-4a13-b463-96d7e030c89d service nova] Creating event network-vif-plugged:cdbce435-f10d-40e7-9b00-ad1252f28480 for instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf on hv-cinder-82869 Sep 09 15:04:12.510988 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-098a1333-a022-48af-97bd-4b6e36bc09ed req-fe57c107-90a6-4a13-b463-96d7e030c89d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050579 Sep 09 15:04:12.511664 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 429/845] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:12.783102 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:12.784101 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:12.789356 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:12.792560 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:12.795123 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:12.795641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:12.796129 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:12.801297 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:12.801986 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:12.802429 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:12.819099 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:12.822838 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:12.823352 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:12.830001 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:12.830672 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:12.831114 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:12.850905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] HTTP exception thrown: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Request method failure captured: Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b HTTP/1.1 Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RTBHu6wiAwS0eDu4gGT_Us-R7ND-j_uGygHncDftmQsFELDYTn0sP_fVJDtrxpBqTrduNRQE2a0FQg-pXpp5N_46MQZWP2trXY3JdvxS7wZl66IjhokZ7wbtVtdxJ6iV-RA6mu-jgF7uLx8sR95IjU3RVzKRzMFqEWKHhrtY9UKxQ Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:04:12.856682 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c83910e3ac2f4c8f9f127ab767bffd1a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 3c0c848f7858486c91773b34047d8aad Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:12.858272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '23ac907a-c540-41ce-bcc5-3339348a221b'} Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:12.859009 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:12.860252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:12.865496 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Returning 404 to user: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:12.866734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-97643db4-5d3e-4b6a-a7c4-0d481d9e35be tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 404 len: 111 microversion: 2.20 time: 0.088234 Sep 09 15:04:12.867862 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 417/846] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:04:12 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 15:04:12.880284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e021713-bab8-4217-a326-9efba1b4102c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '.version_select at 0x7f8ad24b21f0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:12.931853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e021713-bab8-4217-a326-9efba1b4102c tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053946964" status: 204 len: 0 microversion: 2.20 time: 0.058614 Sep 09 15:04:12.933298 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 418/847] 10.222.0.15 () {60 vars in 1262 bytes} [Fri Sep 9 15:04:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053946964 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 15:04:13.082023 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:13.091318 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21d24eeb-088f-4cf0-84e1-bc09fe5fb948 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1265 microversion: 2.1 time: 0.308319 Sep 09 15:04:13.093459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 430/848] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:12 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:04:13.468344 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-0eb94ccc-8ee3-4f28-a820-a6c876a87276 req-1dfd3396-1efb-4dae-ad04-5b8f32ce8081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ac907a-c540-41ce-bcc5-3339348a221b", "name": "network-vif-deleted", "tag": "c8f3dda8-23ee-414a-9861-fbe66c356bcf"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:13.479032 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-0eb94ccc-8ee3-4f28-a820-a6c876a87276 req-1dfd3396-1efb-4dae-ad04-5b8f32ce8081 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:13.479745 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-0eb94ccc-8ee3-4f28-a820-a6c876a87276 req-1dfd3396-1efb-4dae-ad04-5b8f32ce8081 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:13.480180 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-0eb94ccc-8ee3-4f28-a820-a6c876a87276 req-1dfd3396-1efb-4dae-ad04-5b8f32ce8081 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:13.490265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-0eb94ccc-8ee3-4f28-a820-a6c876a87276 req-1dfd3396-1efb-4dae-ad04-5b8f32ce8081 service nova] Creating event network-vif-deleted:c8f3dda8-23ee-414a-9861-fbe66c356bcf for instance 23ac907a-c540-41ce-bcc5-3339348a221b on hv-cinder-82869 Sep 09 15:04:13.495308 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-0eb94ccc-8ee3-4f28-a820-a6c876a87276 req-1dfd3396-1efb-4dae-ad04-5b8f32ce8081 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031986 Sep 09 15:04:13.495864 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 419/849] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:04:14.117400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:14.118154 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:14.124866 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:14.125677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:14.126329 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:14.127247 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:14.127916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:14.128573 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:14.270459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:14.278211 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f15da0d0-a1fa-4c94-b3e5-d4775224e0b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1453 microversion: 2.1 time: 0.164879 Sep 09 15:04:14.278777 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 431/850] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:14 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:14.302241 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:14.302954 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:14.309073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:14.309599 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:14.310048 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:14.310761 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:14.311209 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:14.311640 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:14.456768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:14.465166 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2f7abe04-7900-4221-a026-d39833fcb9ac tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1453 microversion: 2.1 time: 0.167800 Sep 09 15:04:14.465907 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 420/851] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:14 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:14.917470 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:14.918308 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:14.925094 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:14.925835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:14.926272 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:14.927188 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:14.927651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:14.928086 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:14.948422 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] HTTP exception thrown: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Request method failure captured: Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b HTTP/1.1 Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RTBHu6wiAwS0eDu4gGT_Us-R7ND-j_uGygHncDftmQsFELDYTn0sP_fVJDtrxpBqTrduNRQE2a0FQg-pXpp5N_46MQZWP2trXY3JdvxS7wZl66IjhokZ7wbtVtdxJ6iV-RA6mu-jgF7uLx8sR95IjU3RVzKRzMFqEWKHhrtY9UKxQ Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:04:14.950239 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c83910e3ac2f4c8f9f127ab767bffd1a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 3c0c848f7858486c91773b34047d8aad Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.951701 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '23ac907a-c540-41ce-bcc5-3339348a221b'} Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:14.952823 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.954115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.955958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Returning 404 to user: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:14.955958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-056df86b-2881-44b9-a36a-5dac126fb372 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "DELETE /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 404 len: 111 microversion: 2.20 time: 0.038375 Sep 09 15:04:14.955958 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 432/852] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Sep 9 15:04:14 2022] DELETE /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 09 15:04:14.960644 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:14.961819 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: 23ac907a-c540-41ce-bcc5-3339348a221b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:14.968315 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:14.968806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:14.969259 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:14.969997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:14.970662 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:14.971093 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:14.985317 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] HTTP exception thrown: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Request method failure captured: Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b HTTP/1.1 Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RTBHu6wiAwS0eDu4gGT_Us-R7ND-j_uGygHncDftmQsFELDYTn0sP_fVJDtrxpBqTrduNRQE2a0FQg-pXpp5N_46MQZWP2trXY3JdvxS7wZl66IjhokZ7wbtVtdxJ6iV-RA6mu-jgF7uLx8sR95IjU3RVzKRzMFqEWKHhrtY9UKxQ Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:04:14.987213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c83910e3ac2f4c8f9f127ab767bffd1a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 3c0c848f7858486c91773b34047d8aad Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.989663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '23ac907a-c540-41ce-bcc5-3339348a221b'} Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:14.990419 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. Sep 09 15:04:14.991809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:14.994141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Returning 404 to user: Instance 23ac907a-c540-41ce-bcc5-3339348a221b could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:14.994141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-957a665a-ad4c-4278-9085-122f4f326a5b tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b" status: 404 len: 111 microversion: 2.20 time: 0.031806 Sep 09 15:04:14.994141 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 421/853] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:04:14 2022] GET /compute/v2.1/servers/23ac907a-c540-41ce-bcc5-3339348a221b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 09 15:04:15.638380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:15.638885 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:15.646586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:15.647111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:15.647558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:15.648290 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:15.648961 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:15.649444 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:15.654172 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:15.665925 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] HTTP exception thrown: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Request method failure captured: Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 HTTP/1.1 Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1SW0dKu4KuzbnPGsDtvvComdLr7ClzAHVdlz08McaP_r0GzBkzJZrOFMyZymH0SNDhzKI8znucj8Os7HOt2MW7t2jcFJrkwUS6jOzQkRmWOAe7-QQ_Z2VwtcR6OONdyfrVy3CDJuBMjzs4hJf5U9kvXsnvjR22xd4xt-HSC8pHK0Xs Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:04:15.667673 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e498d32cc51a4bad9cb21e58985ce63e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: b72887db5ed34dbebe0d5745cf77c4a8 Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.669367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '704266ae-9ec2-45f2-b2ca-f5e6dcb07d76'} Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:15.670255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.671761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.673763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Returning 404 to user: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:15.673763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f92d36d3-ba2b-4764-ba74-031d58f620b5 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 404 len: 111 microversion: 2.1 time: 0.035725 Sep 09 15:04:15.674938 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 433/854] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:04:15 2022] DELETE /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:04:15.679276 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:15.680089 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:15.686803 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:15.687299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:15.687742 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:15.688766 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:15.689253 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:15.689690 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:15.703562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] HTTP exception thrown: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Request method failure captured: Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 HTTP/1.1 Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1SW0dKu4KuzbnPGsDtvvComdLr7ClzAHVdlz08McaP_r0GzBkzJZrOFMyZymH0SNDhzKI8znucj8Os7HOt2MW7t2jcFJrkwUS6jOzQkRmWOAe7-QQ_Z2VwtcR6OONdyfrVy3CDJuBMjzs4hJf5U9kvXsnvjR22xd4xt-HSC8pHK0Xs Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:04:15.705035 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e498d32cc51a4bad9cb21e58985ce63e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: b72887db5ed34dbebe0d5745cf77c4a8 Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.706618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '704266ae-9ec2-45f2-b2ca-f5e6dcb07d76'} Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:15.707475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. Sep 09 15:04:15.708743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:15.710202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Returning 404 to user: Instance 704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:15.710202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b5ba5629-83e0-492a-b85f-497381e0aa8b tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76" status: 404 len: 111 microversion: 2.1 time: 0.031069 Sep 09 15:04:15.710202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 422/855] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:15 2022] GET /compute/v2.1/servers/704266ae-9ec2-45f2-b2ca-f5e6dcb07d76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 15:04:16.158974 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:16.159512 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:16.167312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:16.167903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:16.168350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:16.169771 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:16.170336 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:16.171082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:16.187917 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] HTTP exception thrown: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Request method failure captured: Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee HTTP/1.1 Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1RTBHu6wiAwS0eDu4gGT_Us-R7ND-j_uGygHncDftmQsFELDYTn0sP_fVJDtrxpBqTrduNRQE2a0FQg-pXpp5N_46MQZWP2trXY3JdvxS7wZl66IjhokZ7wbtVtdxJ6iV-RA6mu-jgF7uLx8sR95IjU3RVzKRzMFqEWKHhrtY9UKxQ Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:04:16.190270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c83910e3ac2f4c8f9f127ab767bffd1a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 3c0c848f7858486c91773b34047d8aad Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.192804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': 'af9e901f-c6b3-4840-ae33-2953c8e39eee'} Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:16.196893 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.198538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.200030 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Returning 404 to user: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:16.200030 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-165b50d3-8411-4aa5-abb8-d7bcb9afae62 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "DELETE /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 404 len: 111 microversion: 2.20 time: 0.040809 Sep 09 15:04:16.200030 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 434/856] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Sep 9 15:04:16 2022] DELETE /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 15:04:16.206703 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:16.207305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] [instance: af9e901f-c6b3-4840-ae33-2953c8e39eee] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:16.215293 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:16.215818 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:16.216259 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:16.216976 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:16.217500 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:16.217927 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:16.233463 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] HTTP exception thrown: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Request method failure captured: Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee HTTP/1.1 Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1RTBHu6wiAwS0eDu4gGT_Us-R7ND-j_uGygHncDftmQsFELDYTn0sP_fVJDtrxpBqTrduNRQE2a0FQg-pXpp5N_46MQZWP2trXY3JdvxS7wZl66IjhokZ7wbtVtdxJ6iV-RA6mu-jgF7uLx8sR95IjU3RVzKRzMFqEWKHhrtY9UKxQ Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:04:16.235236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c83910e3ac2f4c8f9f127ab767bffd1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c83910e3ac2f4c8f9f127ab767bffd1a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: c83910e3ac2f4c8f9f127ab767bffd1a Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1962302861 Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 3c0c848f7858486c91773b34047d8aad Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1962302861-project Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.236755 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': 'af9e901f-c6b3-4840-ae33-2953c8e39eee'} Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:16.237520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. Sep 09 15:04:16.238984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.241295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] Returning 404 to user: Instance af9e901f-c6b3-4840-ae33-2953c8e39eee could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:16.241295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a12bea05-243e-4370-82e8-dd5866da4592 tempest-AttachVolumeShelveTestJSON-1962302861 tempest-AttachVolumeShelveTestJSON-1962302861-project] 10.222.0.15 "GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee" status: 404 len: 111 microversion: 2.20 time: 0.035237 Sep 09 15:04:16.241295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 423/857] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 15:04:16 2022] GET /compute/v2.1/servers/af9e901f-c6b3-4840-ae33-2953c8e39eee => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 15:04:16.657063 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-28e4eeaf-8489-4510-ab44-92089b80c130 req-d94f330b-f282-45da-8df7-c9e27eec8c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc366a9-fbb3-4d0c-a66f-05263ec7fadf", "tag": "cdbce435-f10d-40e7-9b00-ad1252f28480"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:16.670360 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-28e4eeaf-8489-4510-ab44-92089b80c130 req-d94f330b-f282-45da-8df7-c9e27eec8c1e service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:16.672639 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-28e4eeaf-8489-4510-ab44-92089b80c130 req-d94f330b-f282-45da-8df7-c9e27eec8c1e service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:16.673537 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-28e4eeaf-8489-4510-ab44-92089b80c130 req-d94f330b-f282-45da-8df7-c9e27eec8c1e service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:16.685514 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-28e4eeaf-8489-4510-ab44-92089b80c130 req-d94f330b-f282-45da-8df7-c9e27eec8c1e service nova] Creating event network-changed:cdbce435-f10d-40e7-9b00-ad1252f28480 for instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf on hv-cinder-82869 Sep 09 15:04:16.692896 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-28e4eeaf-8489-4510-ab44-92089b80c130 req-d94f330b-f282-45da-8df7-c9e27eec8c1e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040462 Sep 09 15:04:16.693966 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 435/858] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:16.883110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:16.884014 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:16.895277 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:16.896113 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:16.897054 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:16.898408 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:16.899342 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:16.900206 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:16.922718 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] HTTP exception thrown: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Request method failure captured: Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: DELETE /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b HTTP/1.1 Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1SW0dKu4KuzbnPGsDtvvComdLr7ClzAHVdlz08McaP_r0GzBkzJZrOFMyZymH0SNDhzKI8znucj8Os7HOt2MW7t2jcFJrkwUS6jOzQkRmWOAe7-QQ_Z2VwtcR6OONdyfrVy3CDJuBMjzs4hJf5U9kvXsnvjR22xd4xt-HSC8pHK0Xs Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:04:16.925843 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e498d32cc51a4bad9cb21e58985ce63e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: b72887db5ed34dbebe0d5745cf77c4a8 Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.927442 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '762529ff-2c14-4d96-85cb-3908b1f9e26b'} Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:16.928345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.930082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.932693 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Returning 404 to user: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:16.933940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3a624137-027c-4531-9790-477897f7c537 tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "DELETE /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 404 len: 111 microversion: 2.1 time: 0.055843 Sep 09 15:04:16.934858 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 424/859] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:04:16 2022] DELETE /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:04:16.943909 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:16.944612 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] [instance: 762529ff-2c14-4d96-85cb-3908b1f9e26b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:16.950822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:16.951316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:16.951756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:16.952459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:16.952926 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:16.953383 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:16.968052 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] HTTP exception thrown: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Request method failure captured: Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b HTTP/1.1 Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1SW0dKu4KuzbnPGsDtvvComdLr7ClzAHVdlz08McaP_r0GzBkzJZrOFMyZymH0SNDhzKI8znucj8Os7HOt2MW7t2jcFJrkwUS6jOzQkRmWOAe7-QQ_Z2VwtcR6OONdyfrVy3CDJuBMjzs4hJf5U9kvXsnvjR22xd4xt-HSC8pHK0Xs Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:04:16.970225 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e498d32cc51a4bad9cb21e58985ce63e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e498d32cc51a4bad9cb21e58985ce63e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: e498d32cc51a4bad9cb21e58985ce63e Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845768692 Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: b72887db5ed34dbebe0d5745cf77c4a8 Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-1845768692-project Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.972077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '762529ff-2c14-4d96-85cb-3908b1f9e26b'} Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:16.972825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. Sep 09 15:04:16.974212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:16.975591 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] Returning 404 to user: Instance 762529ff-2c14-4d96-85cb-3908b1f9e26b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:16.975591 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4175684d-a9a5-4e1c-a31c-86fd27d11fca tempest-AttachVolumeTestJSON-1845768692 tempest-AttachVolumeTestJSON-1845768692-project] 10.222.0.15 "GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b" status: 404 len: 111 microversion: 2.1 time: 0.031888 Sep 09 15:04:16.975591 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 436/860] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:16 2022] GET /compute/v2.1/servers/762529ff-2c14-4d96-85cb-3908b1f9e26b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 15:04:21.925722 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:21.926836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:21.929984 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-8cf385db-81be-4309-b79a-6eec87130396 req-49e44f09-c403-4122-b945-74b23e205304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de85eb6c-027b-4f9b-95e0-654217d6514e", "tag": "e3d39b24-1d9b-4caf-a284-b75b3c187cde"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:21.934452 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:21.935174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:21.935976 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:21.937145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:21.937963 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:21.939240 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:21.947494 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-8cf385db-81be-4309-b79a-6eec87130396 req-49e44f09-c403-4122-b945-74b23e205304 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:21.948367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-8cf385db-81be-4309-b79a-6eec87130396 req-49e44f09-c403-4122-b945-74b23e205304 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:21.948813 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-8cf385db-81be-4309-b79a-6eec87130396 req-49e44f09-c403-4122-b945-74b23e205304 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:21.965142 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-8cf385db-81be-4309-b79a-6eec87130396 req-49e44f09-c403-4122-b945-74b23e205304 service nova] Creating event network-changed:e3d39b24-1d9b-4caf-a284-b75b3c187cde for instance de85eb6c-027b-4f9b-95e0-654217d6514e on hv-cinder-82869 Sep 09 15:04:21.973814 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-8cf385db-81be-4309-b79a-6eec87130396 req-49e44f09-c403-4122-b945-74b23e205304 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046755 Sep 09 15:04:21.975364 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 437/861] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:04:22.005375 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:04:22.160378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-523ef2d0-914f-4373-8f0e-bdb570c85db1 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "DELETE /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 204 len: 0 microversion: 2.1 time: 0.238744 Sep 09 15:04:22.161262 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 425/862] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:04:21 2022] DELETE /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:04:22.171443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:22.172152 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:22.185963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:22.186969 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:22.187591 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:22.188942 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:22.189599 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:22.190472 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:22.414265 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:22.435116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6c35fae-803d-4eec-81d1-6886eff527e2 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.268533 Sep 09 15:04:22.445551 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 438/863] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:22 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:23.475484 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:23.477043 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:23.491872 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:23.494052 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:23.494384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:23.495095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:23.495551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:23.497315 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:23.708859 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14635358-47d9-4e47-851f-78f46c1aa6b2 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Action: 'create', calling method: .version_select at 0x7f8ad272c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-37254167"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:23.843569 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:23.857410 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c6f103e2-c529-487e-9012-27178f64e631 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1566 microversion: 2.1 time: 0.393384 Sep 09 15:04:23.858383 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 426/864] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:23 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1566 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:24.178442 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14635358-47d9-4e47-851f-78f46c1aa6b2 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.662751 Sep 09 15:04:24.179860 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 439/865] 10.222.0.15 () {60 vars in 1155 bytes} [Fri Sep 9 15:04:23 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 665 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 09 15:04:24.198432 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6ca0aacb-8d9e-4002-9c4b-43fbb252381a tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad25aec10>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:24.267853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6ca0aacb-8d9e-4002-9c4b-43fbb252381a tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4" status: 200 len: 343 microversion: 2.1 time: 0.073883 Sep 09 15:04:24.268456 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 427/866] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:24 2022] GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:24.443060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c568038a-e589-483f-90e8-c9692cc5d299 req-5815ed92-a8c2-43cd-a160-c3b0789d5522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de85eb6c-027b-4f9b-95e0-654217d6514e", "name": "network-vif-deleted", "tag": "e3d39b24-1d9b-4caf-a284-b75b3c187cde"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:24.476255 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c568038a-e589-483f-90e8-c9692cc5d299 req-5815ed92-a8c2-43cd-a160-c3b0789d5522 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:24.476743 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c568038a-e589-483f-90e8-c9692cc5d299 req-5815ed92-a8c2-43cd-a160-c3b0789d5522 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:24.477795 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c568038a-e589-483f-90e8-c9692cc5d299 req-5815ed92-a8c2-43cd-a160-c3b0789d5522 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:24.489782 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c568038a-e589-483f-90e8-c9692cc5d299 req-5815ed92-a8c2-43cd-a160-c3b0789d5522 service nova] Creating event network-vif-deleted:e3d39b24-1d9b-4caf-a284-b75b3c187cde for instance de85eb6c-027b-4f9b-95e0-654217d6514e on hv-cinder-82869 Sep 09 15:04:24.494570 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c568038a-e589-483f-90e8-c9692cc5d299 req-5815ed92-a8c2-43cd-a160-c3b0789d5522 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059978 Sep 09 15:04:24.495171 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 440/867] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:04:24.884291 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:24.885225 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:24.899912 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:24.901474 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:24.901924 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:24.904798 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:24.905820 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:24.906522 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:24.970757 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:24.971526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:24.972392 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:24.972990 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lazy-loading 'fault' on Instance uuid de85eb6c-027b-4f9b-95e0-654217d6514e {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:04:25.039861 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eccc82843084cb392b1f15ad2ac9268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f711f25c212427db970f02391c79d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:25.049864 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48f57a7f-53a3-4ae5-a6fe-e094f1732d47 tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 200 len: 1223 microversion: 2.1 time: 0.171318 Sep 09 15:04:25.051157 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 428/868] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:24 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 1223 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:04:25.285181 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26250165-be59-4156-b27e-44047638660b tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad272cdc0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:25.355077 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26250165-be59-4156-b27e-44047638660b tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4" status: 200 len: 344 microversion: 2.1 time: 0.076483 Sep 09 15:04:25.361459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 441/869] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:25 2022] GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:25.370469 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-10f5b528-47f9-4035-b2a8-b3f9649cef70 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Action: 'create', calling method: .version_select at 0x7f8ad25ae9d0>, body: {"snapshot": {"volume_id": "f2baeaef-146f-476a-be63-dc5f16e752b4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-443372326"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:25.586395 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-10f5b528-47f9-4035-b2a8-b3f9649cef70 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.219731 Sep 09 15:04:25.587774 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 429/870] 10.222.0.15 () {60 vars in 1162 bytes} [Fri Sep 9 15:04:25 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:25.599639 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95104b9a-ccf6-466d-ae82-6316bd53cd51 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad26bda60>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:25.642313 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95104b9a-ccf6-466d-ae82-6316bd53cd51 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753" status: 200 len: 286 microversion: 2.1 time: 0.047125 Sep 09 15:04:25.642892 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 442/871] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 15:04:25 2022] GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:25.656786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f7a3b586-8e9e-4577-81b4-b70f16ab35f3 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad246ef70>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:25.704811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f7a3b586-8e9e-4577-81b4-b70f16ab35f3 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.051611 Sep 09 15:04:25.705960 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 430/872] 10.222.0.15 () {58 vars in 1140 bytes} [Fri Sep 9 15:04:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:25.721708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0daf4592-d3df-4e73-8cfc-8dd6026d19f6 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad25a3280>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:25.754253 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0daf4592-d3df-4e73-8cfc-8dd6026d19f6 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753" status: 200 len: 286 microversion: 2.1 time: 0.041020 Sep 09 15:04:25.754818 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 443/873] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 15:04:25 2022] GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:04:26.078676 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:26.079959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] [instance: de85eb6c-027b-4f9b-95e0-654217d6514e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:26.086406 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:26.086894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:26.087337 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:26.088044 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:26.088505 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:26.088936 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:26.103063 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] HTTP exception thrown: Instance de85eb6c-027b-4f9b-95e0-654217d6514e could not be found. Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Request method failure captured: Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e HTTP/1.1 Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1Sg2M0qfdThP3WoUm2hAKHFyfOje9gdJqqJPBzavO3FjY114Jbyeiazjw9odRrYafQwwwWwE09zbVB4TEmJ7TGeh-vuuwn8By3TxF_KncElPnclLvzRCTFzmw5vYhQugED3NNfAPu3aKb-fUCseVbD_1RqN6uxs5pmBxyDOSzrzXBw Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 3f711f25c212427db970f02391c79d1c Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-TestShelveInstance-1010686211 Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:04:26.104760 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3f711f25c212427db970f02391c79d1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3f711f25c212427db970f02391c79d1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3f711f25c212427db970f02391c79d1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3f711f25c212427db970f02391c79d1c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-TestShelveInstance-1010686211 Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 3f711f25c212427db970f02391c79d1c Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-TestShelveInstance-1010686211 Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-TestShelveInstance-1010686211-project Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 0eccc82843084cb392b1f15ad2ac9268 Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-TestShelveInstance-1010686211-project Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance de85eb6c-027b-4f9b-95e0-654217d6514e could not be found. Sep 09 15:04:26.106478 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': 'de85eb6c-027b-4f9b-95e0-654217d6514e'} Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de85eb6c-027b-4f9b-95e0-654217d6514e could not be found. Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:26.107692 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de85eb6c-027b-4f9b-95e0-654217d6514e could not be found. Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de85eb6c-027b-4f9b-95e0-654217d6514e could not be found. Sep 09 15:04:26.109050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:26.110592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Returning 404 to user: Instance de85eb6c-027b-4f9b-95e0-654217d6514e could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:26.110592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5c23d43a-4145-4ab2-8212-bdae45ba433c tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e" status: 404 len: 111 microversion: 2.1 time: 0.032709 Sep 09 15:04:26.110592 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 431/874] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:26 2022] GET /compute/v2.1/servers/de85eb6c-027b-4f9b-95e0-654217d6514e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 15:04:26.275312 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9fd2d8a-033b-4f1e-a135-8c118868a11e tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] Calling method '.version_select at 0x7f8ad272cf70>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:26.300069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9fd2d8a-033b-4f1e-a135-8c118868a11e tempest-TestShelveInstance-1010686211 tempest-TestShelveInstance-1010686211-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-594703633" status: 202 len: 0 microversion: 2.1 time: 0.028184 Sep 09 15:04:26.300724 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 444/875] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 15:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-594703633 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:04:26.767148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-924a0181-bc8a-4089-bac3-3216f3e883d2 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad258bee0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:26.812608 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-924a0181-bc8a-4089-bac3-3216f3e883d2 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753" status: 200 len: 286 microversion: 2.1 time: 0.049343 Sep 09 15:04:26.817657 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 432/876] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 15:04:26 2022] GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:04:27.825664 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4741abf-97fe-4b79-a52a-49ad724257d2 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad26cbaf0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:27.887832 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4741abf-97fe-4b79-a52a-49ad724257d2 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753" status: 200 len: 286 microversion: 2.1 time: 0.066330 Sep 09 15:04:27.888401 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 445/877] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 15:04:27 2022] GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:28.904730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f9e88ed-cdce-4f64-b86a-34323c2a83d3 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad25cd820>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:28.947305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f9e88ed-cdce-4f64-b86a-34323c2a83d3 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753" status: 200 len: 287 microversion: 2.1 time: 0.050507 Sep 09 15:04:28.948113 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 433/878] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 15:04:28 2022] GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:28.962842 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eee8f488-d188-4c50-9d79-96b33a60a2a7 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad26a1430>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:29.048649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eee8f488-d188-4c50-9d79-96b33a60a2a7 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753" status: 202 len: 0 microversion: 2.1 time: 0.091747 Sep 09 15:04:29.051836 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 446/879] 10.222.0.15 () {58 vars in 1254 bytes} [Fri Sep 9 15:04:28 2022] DELETE /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 15:04:29.060072 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-92bc72a0-b532-4c33-8ac3-b0cc9cc66773 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad25ae9d0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:29.100059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-92bc72a0-b532-4c33-8ac3-b0cc9cc66773 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753" status: 200 len: 286 microversion: 2.1 time: 0.043658 Sep 09 15:04:29.100630 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 434/880] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 15:04:29 2022] GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:30.113370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e9cb6bb-095a-464b-ba6b-7bc118f9385f tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad256d670>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:30.143063 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-6e9cb6bb-095a-464b-ba6b-7bc118f9385f tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] HTTP exception thrown: Snapshot 8702050c-9278-41d0-b1c8-e2a542d2f753 could not be found. Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e9cb6bb-095a-464b-ba6b-7bc118f9385f tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Request method failure captured: Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753 HTTP/1.1 Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1X3fox2Z2bjuM9GZzM96qMjCbUxN06NBp0R8AqVtCbx2WWIh3VZJ35j4SV4DVyJ1mxHmcwkZRxQvaD0A32oyWSr0rwJwXYkCWrP2sfXUlWPw1CDtyk-wd442YhZyO095QQ05li12xF86lDliD9lh1iAACyb1l-QEpxVzGxZYO21oR4 Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 30651414d592424cb3836c8510d3a57e Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:04:30.145649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30651414d592424cb3836c8510d3a57e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30651414d592424cb3836c8510d3a57e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30651414d592424cb3836c8510d3a57e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30651414d592424cb3836c8510d3a57e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 30651414d592424cb3836c8510d3a57e Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotsTestJSON-1814716982-project Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 5283ef11d0a949cc9b0c76c704e3a302 Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814716982-project Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Snapshot 8702050c-9278-41d0-b1c8-e2a542d2f753 could not be found. Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': '8702050c-9278-41d0-b1c8-e2a542d2f753'} Sep 09 15:04:30.147109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8702050c-9278-41d0-b1c8-e2a542d2f753 could not be found. (HTTP 404) (Request-ID: req-b44dbab5-3a7c-44cb-9dde-b58109d90a5a) Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:30.148180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:04:30.149865 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8702050c-9278-41d0-b1c8-e2a542d2f753 could not be found. Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 15:04:30.151448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8702050c-9278-41d0-b1c8-e2a542d2f753 could not be found. Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8702050c-9278-41d0-b1c8-e2a542d2f753 could not be found. Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e9cb6bb-095a-464b-ba6b-7bc118f9385f tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Returning 404 to user: Snapshot 8702050c-9278-41d0-b1c8-e2a542d2f753 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:30.153176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e9cb6bb-095a-464b-ba6b-7bc118f9385f tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753" status: 404 len: 111 microversion: 2.1 time: 0.039057 Sep 09 15:04:30.154202 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 447/881] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 15:04:30 2022] GET /compute/v2.1/os-snapshots/8702050c-9278-41d0-b1c8-e2a542d2f753 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:04:30.156655 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6dbc13a0-c258-404f-89fa-f761de4743d0 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad246e1f0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:30.249753 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6dbc13a0-c258-404f-89fa-f761de4743d0 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4" status: 202 len: 0 microversion: 2.1 time: 0.097358 Sep 09 15:04:30.251394 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 435/882] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 15:04:30 2022] DELETE /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:04:30.275007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3fbf367-bdec-4cf5-adb2-92329063acba tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad26bdd30>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:30.333599 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3fbf367-bdec-4cf5-adb2-92329063acba tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4" status: 200 len: 343 microversion: 2.1 time: 0.064750 Sep 09 15:04:30.334417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 448/883] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:30 2022] GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 => generated 343 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:31.350613 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-006f54e3-42ef-4ecb-88e1-72d74b3874f9 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad25ae040>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:31.385678 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-006f54e3-42ef-4ecb-88e1-72d74b3874f9 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] HTTP exception thrown: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-006f54e3-42ef-4ecb-88e1-72d74b3874f9 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Request method failure captured: Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 HTTP/1.1 Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1X3fox2Z2bjuM9GZzM96qMjCbUxN06NBp0R8AqVtCbx2WWIh3VZJ35j4SV4DVyJ1mxHmcwkZRxQvaD0A32oyWSr0rwJwXYkCWrP2sfXUlWPw1CDtyk-wd442YhZyO095QQ05li12xF86lDliD9lh1iAACyb1l-QEpxVzGxZYO21oR4 Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 30651414d592424cb3836c8510d3a57e Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:04:31.388808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30651414d592424cb3836c8510d3a57e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30651414d592424cb3836c8510d3a57e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30651414d592424cb3836c8510d3a57e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30651414d592424cb3836c8510d3a57e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 30651414d592424cb3836c8510d3a57e Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesSnapshotsTestJSON-1814716982-project Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 5283ef11d0a949cc9b0c76c704e3a302 Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814716982-project Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': 'f2baeaef-146f-476a-be63-dc5f16e752b4'} Sep 09 15:04:31.390448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. (HTTP 404) (Request-ID: req-b56681d0-a9bd-4ff1-8496-aad172ef6ecc) Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:31.391977 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:04:31.393391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 15:04:31.397570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-006f54e3-42ef-4ecb-88e1-72d74b3874f9 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Returning 404 to user: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-006f54e3-42ef-4ecb-88e1-72d74b3874f9 tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4" status: 404 len: 109 microversion: 2.1 time: 0.051089 Sep 09 15:04:31.399811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 436/884] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:31 2022] GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:04:31.410159 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fde2747b-fda0-4293-8bea-ab5b574f0e6d tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad256d160>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:31.445339 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-fde2747b-fda0-4293-8bea-ab5b574f0e6d tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] HTTP exception thrown: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fde2747b-fda0-4293-8bea-ab5b574f0e6d tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Request method failure captured: Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 HTTP/1.1 Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1X3fox2Z2bjuM9GZzM96qMjCbUxN06NBp0R8AqVtCbx2WWIh3VZJ35j4SV4DVyJ1mxHmcwkZRxQvaD0A32oyWSr0rwJwXYkCWrP2sfXUlWPw1CDtyk-wd442YhZyO095QQ05li12xF86lDliD9lh1iAACyb1l-QEpxVzGxZYO21oR4 Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 30651414d592424cb3836c8510d3a57e Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:04:31.447564 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30651414d592424cb3836c8510d3a57e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30651414d592424cb3836c8510d3a57e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30651414d592424cb3836c8510d3a57e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30651414d592424cb3836c8510d3a57e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 30651414d592424cb3836c8510d3a57e Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotsTestJSON-1814716982-project Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 5283ef11d0a949cc9b0c76c704e3a302 Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814716982-project Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': 'f2baeaef-146f-476a-be63-dc5f16e752b4'} Sep 09 15:04:31.449132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. (HTTP 404) (Request-ID: req-2f19607b-5b60-47f2-8d3d-689e6654b52e) Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:31.450109 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 15:04:31.451448 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 15:04:31.452812 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.454851 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.457919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fde2747b-fda0-4293-8bea-ab5b574f0e6d tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Returning 404 to user: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:31.459040 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fde2747b-fda0-4293-8bea-ab5b574f0e6d tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4" status: 404 len: 109 microversion: 2.1 time: 0.055338 Sep 09 15:04:31.459585 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 449/885] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 15:04:31 2022] DELETE /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:04:31.468204 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb57cfbb-3c4a-4a50-adae-435b19fbf78b tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Calling method '.version_select at 0x7f8ad258b160>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:31.506094 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-cb57cfbb-3c4a-4a50-adae-435b19fbf78b tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] HTTP exception thrown: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb57cfbb-3c4a-4a50-adae-435b19fbf78b tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Request method failure captured: Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 HTTP/1.1 Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1X3fox2Z2bjuM9GZzM96qMjCbUxN06NBp0R8AqVtCbx2WWIh3VZJ35j4SV4DVyJ1mxHmcwkZRxQvaD0A32oyWSr0rwJwXYkCWrP2sfXUlWPw1CDtyk-wd442YhZyO095QQ05li12xF86lDliD9lh1iAACyb1l-QEpxVzGxZYO21oR4 Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 30651414d592424cb3836c8510d3a57e Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:04:31.508812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30651414d592424cb3836c8510d3a57e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30651414d592424cb3836c8510d3a57e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30651414d592424cb3836c8510d3a57e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30651414d592424cb3836c8510d3a57e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 30651414d592424cb3836c8510d3a57e Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1814716982 Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesSnapshotsTestJSON-1814716982-project Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 5283ef11d0a949cc9b0c76c704e3a302 Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1814716982-project Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': 'f2baeaef-146f-476a-be63-dc5f16e752b4'} Sep 09 15:04:31.510299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. (HTTP 404) (Request-ID: req-2a938f8b-c9d8-43fc-9667-85ddd9207284) Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:31.511358 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:04:31.512748 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 15:04:31.514110 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. Sep 09 15:04:31.515562 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:31.517949 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb57cfbb-3c4a-4a50-adae-435b19fbf78b tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] Returning 404 to user: Volume f2baeaef-146f-476a-be63-dc5f16e752b4 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:31.518845 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cb57cfbb-3c4a-4a50-adae-435b19fbf78b tempest-VolumesSnapshotsTestJSON-1814716982 tempest-VolumesSnapshotsTestJSON-1814716982-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4" status: 404 len: 109 microversion: 2.1 time: 0.054935 Sep 09 15:04:31.519572 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 437/886] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:31 2022] GET /compute/v2.1/os-volumes/f2baeaef-146f-476a-be63-dc5f16e752b4 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:04:34.030984 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-471809c7-94c3-41ba-ae56-11dc53b2759d tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] Action: 'create', calling method: .version_select at 0x7f8ad26cb1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-955090204", "metadata": {"Type": "work"}}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:34.487137 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=17 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:34.511584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-471809c7-94c3-41ba-ae56-11dc53b2759d tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.687322 Sep 09 15:04:34.513111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 450/887] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Sep 9 15:04:33 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 689 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 15:04:34.527855 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bca7dbf8-4bd8-4dbe-88a8-3deae2e811b6 tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] Calling method '.version_select at 0x7f8ad2545700>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:34.618334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bca7dbf8-4bd8-4dbe-88a8-3deae2e811b6 tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7" status: 200 len: 352 microversion: 2.1 time: 0.096015 Sep 09 15:04:34.618914 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 438/888] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:34 2022] GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:35.634232 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d94dac8-222f-4c7b-8e40-69a55361316b tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] Calling method '.version_select at 0x7f8ad25a3700>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:35.687031 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d94dac8-222f-4c7b-8e40-69a55361316b tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7" status: 200 len: 353 microversion: 2.1 time: 0.053909 Sep 09 15:04:35.687635 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 451/889] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:35 2022] GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:35.701239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-78dcb752-d46f-4c6d-b7cd-0ed34f6971ec tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] Calling method '.version_select at 0x7f8ad25f9f70>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:35.747026 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-78dcb752-d46f-4c6d-b7cd-0ed34f6971ec tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7" status: 200 len: 353 microversion: 2.1 time: 0.050096 Sep 09 15:04:35.747673 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 439/890] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:35 2022] GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:04:35.767096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce49b063-d725-4545-9dc9-b290e18f4d15 tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] Calling method '.version_select at 0x7f8ad26a15e0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:35.828422 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce49b063-d725-4545-9dc9-b290e18f4d15 tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7" status: 202 len: 0 microversion: 2.1 time: 0.066218 Sep 09 15:04:35.832649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 452/891] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 15:04:35 2022] DELETE /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:04:35.838704 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7a8ce9c9-b166-4171-bc78-9731addd76e2 tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] Calling method '.version_select at 0x7f8ad26b3160>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:35.887174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7a8ce9c9-b166-4171-bc78-9731addd76e2 tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7" status: 200 len: 352 microversion: 2.1 time: 0.053080 Sep 09 15:04:35.887743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 440/892] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:35 2022] GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:36.467495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:36.472184 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1067779421", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "networks": [{"uuid": "cabe1b09-87d8-4886-a7a5-9c46fbfdfcdc"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:36.528136 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] validate_networks() for [('cabe1b09-87d8-4886-a7a5-9c46fbfdfcdc', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:04:36.896518 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:04:36.897086 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:04:36.898188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:36.898608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:04:36.898695 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:04:36.898939 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:36.899287 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:04:36.907888 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-62f9f6a1-1098-4275-8ec8-a0f32573a25b tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] Calling method '.version_select at 0x7f8ad278f310>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:36.909718 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:36.910205 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:36.910641 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:36.911365 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:36.911817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:36.912374 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:36.935669 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Getting quotas for project 781a403f041b4389b804107c30ffedac. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:04:36.939770 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Getting quotas for user 33a5368bd6fb4ebeba76c5f6ce0c7c28 and project 781a403f041b4389b804107c30ffedac. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:04:36.940239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-62f9f6a1-1098-4275-8ec8-a0f32573a25b tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] HTTP exception thrown: Volume 317e3961-2348-46f0-b05a-e5ea9f1011a7 could not be found. Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-62f9f6a1-1098-4275-8ec8-a0f32573a25b tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] Request method failure captured: Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7 HTTP/1.1 Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1YBy0fZpbnxOA1nVNZ_znwPyWQ57ziXG4aBivgq7Q1zDU5m2j6mGhDFPQx8bZz1hG0Nmpf9sBQa51wMz1N6H5sgbG0ds5lKv8WcNBIKIJYdTrmqJ1b7wOVwZD1TIDGuuPPI7F5w8_AP_H8kU9-ZaAEMpEzHuwkZiirgZisJjk52gPM Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 1d18f2167d98453e9d8d56619b7e53b7 Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesGetTestJSON-1856781565 Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:04:36.942459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1d18f2167d98453e9d8d56619b7e53b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1d18f2167d98453e9d8d56619b7e53b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1d18f2167d98453e9d8d56619b7e53b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1d18f2167d98453e9d8d56619b7e53b7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesGetTestJSON-1856781565 Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 1d18f2167d98453e9d8d56619b7e53b7 Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesGetTestJSON-1856781565 Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesGetTestJSON-1856781565-project Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: ea20af879c5647208871f2114e1b77ee Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesGetTestJSON-1856781565-project Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Volume 317e3961-2348-46f0-b05a-e5ea9f1011a7 could not be found. Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '317e3961-2348-46f0-b05a-e5ea9f1011a7'} Sep 09 15:04:36.944049 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 317e3961-2348-46f0-b05a-e5ea9f1011a7 could not be found. (HTTP 404) (Request-ID: req-17c97e8f-5363-4166-906b-4d880946e909) Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:36.945012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 15:04:36.946459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 317e3961-2348-46f0-b05a-e5ea9f1011a7 could not be found. Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 15:04:36.947797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 317e3961-2348-46f0-b05a-e5ea9f1011a7 could not be found. Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 317e3961-2348-46f0-b05a-e5ea9f1011a7 could not be found. Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-62f9f6a1-1098-4275-8ec8-a0f32573a25b tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] Returning 404 to user: Volume 317e3961-2348-46f0-b05a-e5ea9f1011a7 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-62f9f6a1-1098-4275-8ec8-a0f32573a25b tempest-VolumesGetTestJSON-1856781565 tempest-VolumesGetTestJSON-1856781565-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7" status: 404 len: 109 microversion: 2.1 time: 0.046978 Sep 09 15:04:36.949510 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 441/893] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 15:04:36 2022] GET /compute/v2.1/os-volumes/317e3961-2348-46f0-b05a-e5ea9f1011a7 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 15:04:36.960540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:04:36.963560 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:04:37.020973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa5a0025-604b-4f88-94fc-8cf511708fa8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554087 Sep 09 15:04:37.021923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 453/894] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:04:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 15:04:37.039615 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f67945bd-273e-4ad7-bda7-8e17132bb655 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:37.040264 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f67945bd-273e-4ad7-bda7-8e17132bb655 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:37.108788 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f67945bd-273e-4ad7-bda7-8e17132bb655 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:37.116776 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f67945bd-273e-4ad7-bda7-8e17132bb655 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1219 microversion: 2.1 time: 0.087676 Sep 09 15:04:37.118244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 442/895] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:37 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:38.145327 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:38.146739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:38.155756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:38.156515 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:38.157516 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:38.158226 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:38.158685 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:38.159242 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:38.258923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:38.269168 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-575f9389-0198-494c-929c-9c58ad3e5d12 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1271 microversion: 2.1 time: 0.132976 Sep 09 15:04:38.269775 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 454/896] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:38 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:39.293660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:39.294563 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:39.303100 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:39.303601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:39.304063 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:39.305076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:39.305734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:39.306169 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:39.519017 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:39.527872 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-915a27c8-78ea-4cb9-95e8-aa61bbd05817 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.238506 Sep 09 15:04:39.541565 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 443/897] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:39 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:39.859607 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-062b40f9-84d1-4cfb-956a-b2471d15f9a3 req-58139424-0aa4-4628-8fe8-3c105b7df600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f246716f-ca32-4078-8e7e-58f3bcc0e551", "tag": "70730290-f34e-4056-a5f6-7f3a92add641"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:39.874367 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-062b40f9-84d1-4cfb-956a-b2471d15f9a3 req-58139424-0aa4-4628-8fe8-3c105b7df600 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:39.876235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-062b40f9-84d1-4cfb-956a-b2471d15f9a3 req-58139424-0aa4-4628-8fe8-3c105b7df600 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:39.876891 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-062b40f9-84d1-4cfb-956a-b2471d15f9a3 req-58139424-0aa4-4628-8fe8-3c105b7df600 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:39.894907 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-062b40f9-84d1-4cfb-956a-b2471d15f9a3 req-58139424-0aa4-4628-8fe8-3c105b7df600 service nova] Creating event network-changed:70730290-f34e-4056-a5f6-7f3a92add641 for instance f246716f-ca32-4078-8e7e-58f3bcc0e551 on hv-cinder-82869 Sep 09 15:04:39.902457 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-062b40f9-84d1-4cfb-956a-b2471d15f9a3 req-58139424-0aa4-4628-8fe8-3c105b7df600 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051144 Sep 09 15:04:39.903370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 455/898] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:04:40.555332 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:40.555951 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:40.562059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:40.562479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:40.562916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:40.563633 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:40.564084 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:40.564508 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:40.704488 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:40.712708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2b5d3558-d460-469d-ba1e-a69c09f4fc95 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.164095 Sep 09 15:04:40.713301 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 444/899] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:40 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:41.737216 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:41.737992 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:41.744705 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:41.745231 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:41.745704 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:41.746401 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:41.746859 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:41.747299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:41.896104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:41.904680 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d56607eb-2c02-48ae-aaa3-7d352e121e5e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.172940 Sep 09 15:04:41.905459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 456/900] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:41 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:42.930630 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:42.931268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:42.937771 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:42.938441 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:42.938886 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:42.939588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:42.940048 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:42.940477 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:43.072895 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:43.081511 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-af879057-6868-4abd-861d-266b904318ac tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.155651 Sep 09 15:04:43.082076 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 445/901] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:42 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:44.104633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:44.105265 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:44.112216 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:44.112697 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:44.113134 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:44.113956 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:44.114409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:44.114829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:44.244062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:44.251938 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b6dfbc3-fdc0-4b3f-9bec-3538cf6ace2e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.151222 Sep 09 15:04:44.252489 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 457/902] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:44 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:45.273622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:45.274237 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:45.280618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:45.281097 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:45.281862 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:45.283194 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:45.283650 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:45.284072 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:45.411809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:45.419845 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fea3d42c-8852-40bf-a092-68718ffb987d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.150087 Sep 09 15:04:45.420407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 446/903] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:45 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:46.441563 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:46.442166 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:46.448513 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:46.448995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:46.449453 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:46.450139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:46.450587 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:46.451003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:46.598064 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:46.608782 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4aa45dad-957e-4993-9ec1-0cdc7ad45202 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.171034 Sep 09 15:04:46.609509 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 458/904] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:46 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:47.632583 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:47.633265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:47.635786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:47.642012 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:47.642502 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:47.642940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:47.643671 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:47.644126 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:47.644550 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:47.797622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:47.807539 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4e9ff695-eceb-4077-aaa8-4801db1faafa tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.178390 Sep 09 15:04:47.807766 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 447/905] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:47 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:47.940629 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-96c58da3-463e-498d-b8e4-2deb768c4c09 req-cf8fb1a6-7621-49fc-893a-f170ea849131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f246716f-ca32-4078-8e7e-58f3bcc0e551", "name": "network-vif-plugged", "status": "completed", "tag": "70730290-f34e-4056-a5f6-7f3a92add641"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:04:47.949348 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:47.950684 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:47.959613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-96c58da3-463e-498d-b8e4-2deb768c4c09 req-cf8fb1a6-7621-49fc-893a-f170ea849131 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:47.960408 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-96c58da3-463e-498d-b8e4-2deb768c4c09 req-cf8fb1a6-7621-49fc-893a-f170ea849131 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:47.961074 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-96c58da3-463e-498d-b8e4-2deb768c4c09 req-cf8fb1a6-7621-49fc-893a-f170ea849131 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:47.974380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-96c58da3-463e-498d-b8e4-2deb768c4c09 req-cf8fb1a6-7621-49fc-893a-f170ea849131 service nova] Creating event network-vif-plugged:70730290-f34e-4056-a5f6-7f3a92add641 for instance f246716f-ca32-4078-8e7e-58f3bcc0e551 on hv-cinder-82869 Sep 09 15:04:47.980687 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-96c58da3-463e-498d-b8e4-2deb768c4c09 req-cf8fb1a6-7621-49fc-893a-f170ea849131 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049206 Sep 09 15:04:47.981565 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 459/906] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:04:48.831593 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:48.832271 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:48.838744 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:48.839227 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:48.839660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:48.840349 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:48.840805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:48.841344 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:48.977862 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:48.988778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3e7a3786-f6ef-4de1-99cb-93cb19c1d434 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.158859 Sep 09 15:04:48.988778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 448/907] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:48 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:50.008684 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:50.009882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:50.020546 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:50.020546 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:50.020546 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:50.020546 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:50.020844 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:50.020844 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:50.154214 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:50.162881 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-476f1834-a1da-4913-a06d-f243a77cf9a4 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.158344 Sep 09 15:04:50.163524 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 460/908] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:50 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:51.184907 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:51.185551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:51.192563 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:51.193047 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:51.193519 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:51.194210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:51.194669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:51.195099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:51.323377 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:51.330974 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b56acbe-ed00-42bf-bf10-6b6b0a0f98a3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1319 microversion: 2.1 time: 0.149937 Sep 09 15:04:51.331544 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 449/909] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:51 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:04:52.353578 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:04:52.354120 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:04:52.360487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:52.360970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:52.361439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:52.362128 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:04:52.362583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:04:52.363009 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:04:52.494876 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:04:52.503069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d7bc7cb-bf19-483a-b0f2-bb544bc52b89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1508 microversion: 2.1 time: 0.153525 Sep 09 15:04:52.503623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 461/910] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:04:52 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:10.871767 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c8fd786-e84e-4e4f-854c-5ac83e9c3217 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0005cdd-41f1-4ae0-9351-c4de394d375a", "device": "/dev/sdb"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:05:10.874834 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c8fd786-e84e-4e4f-854c-5ac83e9c3217 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:10.877087 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=18 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:10.877872 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=42 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:10.883870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8fd786-e84e-4e4f-854c-5ac83e9c3217 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:10.884423 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8fd786-e84e-4e4f-854c-5ac83e9c3217 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:10.884861 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8fd786-e84e-4e4f-854c-5ac83e9c3217 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:10.885671 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8fd786-e84e-4e4f-854c-5ac83e9c3217 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:10.886216 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8fd786-e84e-4e4f-854c-5ac83e9c3217 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:10.886868 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8fd786-e84e-4e4f-854c-5ac83e9c3217 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:11.132302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c8fd786-e84e-4e4f-854c-5ac83e9c3217 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "POST /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265001 Sep 09 15:05:11.134312 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 450/911] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:05:10 2022] POST /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:05:16.305530 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-994387691", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:05:16.312577 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:16.313418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=42 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:16.357377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] validate_networks() for None {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:05:16.627985 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:05:16.628401 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:05:16.629477 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:05:16.629885 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:05:16.630293 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:05:16.638944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:16.639424 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:16.639854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:16.640569 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:16.641019 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:16.641469 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:16.657787 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Getting quotas for project 4935439b82154c548b0bfad252c407b7. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:05:16.661655 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Getting quotas for user fd32d1d55f274ac8ac7113a8f29349a0 and project 4935439b82154c548b0bfad252c407b7. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:05:16.672240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:05:16.674505 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:05:16.720040 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c5cc98c-a090-4eaf-be64-e809850d414a tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.418447 Sep 09 15:05:16.721026 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 462/912] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 15:05:16.732996 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-15bc6ddf-8c5a-4c02-be1d-387295deba7d tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:16.734347 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-15bc6ddf-8c5a-4c02-be1d-387295deba7d tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:16.787588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-15bc6ddf-8c5a-4c02-be1d-387295deba7d tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:16.794504 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-15bc6ddf-8c5a-4c02-be1d-387295deba7d tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1214 microversion: 2.1 time: 0.066209 Sep 09 15:05:16.795063 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 451/913] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:16 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:17.819121 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:17.819747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:17.826177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:17.826657 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:17.827087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:17.827769 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:17.828218 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:17.828638 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:18.140044 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:18.147584 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f32ad844-3be5-446d-9283-648628823707 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1266 microversion: 2.1 time: 0.333621 Sep 09 15:05:18.148141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 463/914] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:17 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1266 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:19.171128 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:19.171740 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:19.178912 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:19.179391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:19.179822 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:19.180508 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:19.180958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:19.181411 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:19.241526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:19.249041 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bc3144ce-b84a-4a5f-b4f5-14f86ddca146 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1284 microversion: 2.1 time: 0.081796 Sep 09 15:05:19.249626 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 452/915] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:19 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1284 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:20.272005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:20.272613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:20.278990 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:20.279469 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:20.279902 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:20.280583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:20.281035 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:20.281485 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:20.344115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:20.352276 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac951cc4-2b3f-482b-800c-4c90ff3c4278 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1284 microversion: 2.1 time: 0.084654 Sep 09 15:05:20.352840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 464/916] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:20 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:21.376520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:21.377284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:21.383770 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:21.384266 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:21.384701 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:21.385435 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:21.385889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:21.386311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:21.462564 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:21.470528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c59a8304-3c26-4034-b01d-1e49a211212b tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1272 microversion: 2.1 time: 0.099404 Sep 09 15:05:21.471098 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 453/917] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:21 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:22.494501 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:22.495107 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:22.501524 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:22.502007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:22.502441 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:22.503133 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:22.504254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:22.504680 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:22.634281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:22.641921 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b89c6ecc-a465-4c2e-a179-3b73bc422e51 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.151275 Sep 09 15:05:22.642509 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 465/918] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:22 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:23.666195 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:23.666891 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:23.674284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:23.674771 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:23.675252 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:23.675946 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:23.676403 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:23.676830 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:23.802560 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:23.810173 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-272144d4-da85-4158-bf49-723bc82bca1e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.149491 Sep 09 15:05:23.810743 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 454/919] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:23 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:24.645717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-49ec3d80-e641-43e8-ad99-9f71cad94dd8 req-c7de4411-df4b-4252-afda-0d4013cfd6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46e645a9-d8ab-4371-a36e-a2d2e63c3670", "tag": "63833e34-1dcd-4b56-95f8-cb3d86459d36"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:05:24.655597 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-49ec3d80-e641-43e8-ad99-9f71cad94dd8 req-c7de4411-df4b-4252-afda-0d4013cfd6c0 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:24.656076 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-49ec3d80-e641-43e8-ad99-9f71cad94dd8 req-c7de4411-df4b-4252-afda-0d4013cfd6c0 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:24.656521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-49ec3d80-e641-43e8-ad99-9f71cad94dd8 req-c7de4411-df4b-4252-afda-0d4013cfd6c0 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:24.668290 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-49ec3d80-e641-43e8-ad99-9f71cad94dd8 req-c7de4411-df4b-4252-afda-0d4013cfd6c0 service nova] Creating event network-changed:63833e34-1dcd-4b56-95f8-cb3d86459d36 for instance 46e645a9-d8ab-4371-a36e-a2d2e63c3670 on hv-cinder-82869 Sep 09 15:05:24.673811 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-49ec3d80-e641-43e8-ad99-9f71cad94dd8 req-c7de4411-df4b-4252-afda-0d4013cfd6c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031676 Sep 09 15:05:24.675050 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 466/920] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:05:24.833181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:24.833891 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:24.840973 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:24.841693 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:24.842140 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:24.843131 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:24.843904 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:24.844618 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:25.049635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:25.057574 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-decd9ab3-58a8-4de1-ae41-4d2f61e3e4f9 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.228814 Sep 09 15:05:25.058380 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 455/921] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:24 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:26.082536 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:26.083228 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:26.090833 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:26.091321 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:26.091786 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:26.092473 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:26.092927 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:26.093387 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:26.222756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:26.230464 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7aac897d-0a5b-460a-b3d2-7be1b846728f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.152959 Sep 09 15:05:26.231032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 467/922] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:26 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:27.253784 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:27.254423 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:27.256790 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:27.262184 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:27.262665 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:27.263101 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:27.263786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:27.264238 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:27.264660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:27.394996 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:27.402587 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2a19ccb0-fafd-4cef-a9fb-8e4181753b91 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.153256 Sep 09 15:05:27.403148 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 456/923] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:27 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:28.426095 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:28.426708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:28.428643 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:28.429337 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:28.435970 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:28.436754 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:28.436888 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:28.437573 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:28.438023 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:28.438442 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:28.565428 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:28.573618 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f12d353e-3bff-4843-9a27-6388936a00c6 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.151345 Sep 09 15:05:28.574090 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 468/924] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:28 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:29.597488 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:29.598098 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:29.606080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:29.606570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:29.607004 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:29.607701 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:29.608153 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:29.608609 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:29.780551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:29.788405 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-aaed4202-1fa1-4d7f-adf0-c6b52d5e9e54 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.194705 Sep 09 15:05:29.788963 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 457/925] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:29 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:30.811464 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:30.812150 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:30.818738 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:30.819221 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:30.819658 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:30.820345 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:30.820799 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:30.821250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:30.946939 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:30.954674 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd364b04-558c-4b03-9e9d-21a30c8a068e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.147234 Sep 09 15:05:30.955233 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 469/926] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:30 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:31.978254 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:31.978863 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:31.985192 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:31.985691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:31.986122 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:31.986805 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:31.987255 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:31.988324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:32.118686 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:32.126494 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4e9780df-423f-44cf-b56f-ad2955f7f799 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.152195 Sep 09 15:05:32.127050 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 458/927] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:31 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:32.807122 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:32.807619 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:32.813434 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:32.813916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:32.814347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:32.815030 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:32.815478 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:32.816422 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:32.898936 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'services' on Instance uuid f246716f-ca32-4078-8e7e-58f3bcc0e551 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:05:32.969056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a4cbcc5-2ed2-4628-9e92-769f65d5dc4c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551/os-volume_attachments/f0005cdd-41f1-4ae0-9351-c4de394d375a" status: 202 len: 0 microversion: 2.1 time: 0.165766 Sep 09 15:05:32.969678 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 470/928] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:05:32 2022] DELETE /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551/os-volume_attachments/f0005cdd-41f1-4ae0-9351-c4de394d375a => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:05:33.149363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:33.149995 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:33.156628 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:33.157417 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:33.157865 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:33.158570 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:33.159031 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:33.159459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:33.265889 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-e81eaca2-d3a7-4add-9228-4576c472ce08 req-22596498-6858-4932-b713-8d65d942f9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e645a9-d8ab-4371-a36e-a2d2e63c3670", "name": "network-vif-plugged", "status": "completed", "tag": "63833e34-1dcd-4b56-95f8-cb3d86459d36"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:05:33.276475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e81eaca2-d3a7-4add-9228-4576c472ce08 req-22596498-6858-4932-b713-8d65d942f9f1 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:33.277227 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e81eaca2-d3a7-4add-9228-4576c472ce08 req-22596498-6858-4932-b713-8d65d942f9f1 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:33.277691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e81eaca2-d3a7-4add-9228-4576c472ce08 req-22596498-6858-4932-b713-8d65d942f9f1 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:33.291036 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:33.298410 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-e81eaca2-d3a7-4add-9228-4576c472ce08 req-22596498-6858-4932-b713-8d65d942f9f1 service nova] Creating event network-vif-plugged:63833e34-1dcd-4b56-95f8-cb3d86459d36 for instance 46e645a9-d8ab-4371-a36e-a2d2e63c3670 on hv-cinder-82869 Sep 09 15:05:33.300502 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-70b8d7ce-5c15-4631-ac59-d7a2335f92ad tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.154381 Sep 09 15:05:33.301159 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 459/929] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:33 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:33.314547 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-e81eaca2-d3a7-4add-9228-4576c472ce08 req-22596498-6858-4932-b713-8d65d942f9f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052738 Sep 09 15:05:33.315393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 471/930] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:05:34.104794 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:34.105334 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:34.111540 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:34.112024 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:34.112481 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:34.113181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:34.113661 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:34.114092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:34.139587 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:05:34.217239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1cc3a8d2-b1d5-4df0-832a-90f5e35b65b2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 204 len: 0 microversion: 2.1 time: 0.115750 Sep 09 15:05:34.218087 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 460/931] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:05:34 2022] DELETE /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:05:34.228360 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:34.229063 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:34.235148 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:34.235616 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:34.236048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:34.236727 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:34.237176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:34.237651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:34.330735 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:34.332010 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:34.338056 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:34.338524 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:34.338958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:34.339645 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:34.340100 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:34.340518 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:34.367173 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:34.375377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83cb9c30-6a0f-48f0-a50d-b63267269f3e tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1514 microversion: 2.1 time: 0.152850 Sep 09 15:05:34.375941 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 472/932] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:34 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:05:34.476058 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:34.483638 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a4146a3e-8c98-4cd1-8133-46962c4dc5c0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.157036 Sep 09 15:05:34.484202 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 461/933] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:34 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:05:35.399397 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:35.400012 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:35.406506 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:35.407244 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:35.407677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:35.408364 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:35.408817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:35.409266 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:35.505996 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:35.506719 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:35.513253 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:35.513813 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:35.514327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:35.515092 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:35.515622 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:35.516131 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:35.540468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:35.548139 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-963bef68-0325-407d-93c1-43c803b223d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1514 microversion: 2.1 time: 0.152617 Sep 09 15:05:35.548696 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 473/934] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:35 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:35.649800 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:35.657711 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d4b0780c-d4e0-4721-85e6-3487cb1d12fa tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1314 microversion: 2.1 time: 0.155568 Sep 09 15:05:35.658312 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 462/935] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:35 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:05:36.571176 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:36.571809 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:36.578583 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:36.579651 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:36.580127 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:36.580998 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:36.581475 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:36.581929 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:36.611422 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-d7a2d889-d34f-4eb5-b84d-d6bd8c47ec10 req-7e708e00-5aae-478d-a1f8-6b49210723c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f246716f-ca32-4078-8e7e-58f3bcc0e551", "name": "network-vif-deleted", "tag": "70730290-f34e-4056-a5f6-7f3a92add641"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:05:36.632947 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-d7a2d889-d34f-4eb5-b84d-d6bd8c47ec10 req-7e708e00-5aae-478d-a1f8-6b49210723c6 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:36.634626 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-d7a2d889-d34f-4eb5-b84d-d6bd8c47ec10 req-7e708e00-5aae-478d-a1f8-6b49210723c6 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:36.635029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-d7a2d889-d34f-4eb5-b84d-d6bd8c47ec10 req-7e708e00-5aae-478d-a1f8-6b49210723c6 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:36.646476 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-d7a2d889-d34f-4eb5-b84d-d6bd8c47ec10 req-7e708e00-5aae-478d-a1f8-6b49210723c6 service nova] Creating event network-vif-deleted:70730290-f34e-4056-a5f6-7f3a92add641 for instance f246716f-ca32-4078-8e7e-58f3bcc0e551 on hv-cinder-82869 Sep 09 15:05:36.651155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-d7a2d889-d34f-4eb5-b84d-d6bd8c47ec10 req-7e708e00-5aae-478d-a1f8-6b49210723c6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043590 Sep 09 15:05:36.651708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:36.651862 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 463/936] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:05:36.661127 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-688fdd57-ab59-4fe1-855e-655b51c15e27 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1472 microversion: 2.1 time: 0.093840 Sep 09 15:05:36.661728 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 474/937] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:36 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:36.680663 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:36.681417 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:36.688086 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:36.688569 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:36.689008 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:36.689727 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:36.690181 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:36.690630 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:36.825388 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:36.833540 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-862ff671-7f68-434e-9176-d4c98e4751e2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1464 microversion: 2.1 time: 0.156963 Sep 09 15:05:36.834095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 464/938] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:36 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:05:36.879529 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:36.880026 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:36.885850 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:36.886334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:36.886764 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:36.887446 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:36.887898 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:36.888319 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:36.913619 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:05:36.985849 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f774cf38-0181-4d8e-a1c0-1507eebeead2 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "DELETE /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 204 len: 0 microversion: 2.1 time: 0.110192 Sep 09 15:05:36.986420 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 475/939] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:05:36 2022] DELETE /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:05:36.994447 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:36.995068 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:37.000926 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:37.001451 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:37.001889 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:37.002581 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:37.003042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:37.003469 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:37.007479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:37.139332 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:37.147695 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ddc2c1ae-9037-48a1-9976-2ce2704acab0 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1470 microversion: 2.1 time: 0.157036 Sep 09 15:05:37.148258 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 465/940] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:36 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:37.684417 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:37.685115 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:37.692141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:37.692621 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:37.693054 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:37.693759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:37.694210 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:37.694629 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:37.727156 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:37.727633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:37.728060 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:37.728495 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid f246716f-ca32-4078-8e7e-58f3bcc0e551 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:05:37.769107 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:37.776537 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d4ccaeb-e954-48e1-b84f-34be50aa1d71 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 200 len: 1309 microversion: 2.1 time: 0.096441 Sep 09 15:05:37.777106 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 476/941] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:37 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:38.170875 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:38.171488 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:38.178626 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:38.179109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:38.179543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:38.180230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:38.180683 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:38.181104 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:38.310509 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:38.318127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d3c8261a-ed4b-4b6d-afb2-6d27d4b89817 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1470 microversion: 2.1 time: 0.151145 Sep 09 15:05:38.318686 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 466/942] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:38 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:38.799779 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:38.800498 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: f246716f-ca32-4078-8e7e-58f3bcc0e551] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:38.807996 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:38.808681 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:38.809130 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:38.809938 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:38.810338 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:38.810768 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:38.827196 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] HTTP exception thrown: Instance f246716f-ca32-4078-8e7e-58f3bcc0e551 could not be found. Sep 09 15:05:38.827425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-8a01068e-9242-454a-9d3d-2ad428450787 req-5cb1b94f-b383-4567-9f9e-5a823df51d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e645a9-d8ab-4371-a36e-a2d2e63c3670", "name": "network-vif-deleted", "tag": "63833e34-1dcd-4b56-95f8-cb3d86459d36"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Request method failure captured: Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 HTTP/1.1 Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1YCnGXnclySUswqkxj-18l0DY9vwmerlmNpheOkX_b_ny7t5IROkc6nagW3b0j37EH-hntJWZpdgkq18AxQVXWLuX1RaxVRLB2ePdY5NMJGsP8y_Ub0MvyMRgCS4JB4rKWbUKrrbq6VumbqTSUe1S4zrDaWHtILuTl7Bfqh2CNEmcY Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 781a403f041b4389b804107c30ffedac Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotTestJSON-349852722 Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:05:38.828873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/781a403f041b4389b804107c30ffedac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/781a403f041b4389b804107c30ffedac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/781a403f041b4389b804107c30ffedac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_781a403f041b4389b804107c30ffedac", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotTestJSON-349852722 Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 781a403f041b4389b804107c30ffedac Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-349852722 Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotTestJSON-349852722-project Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 33a5368bd6fb4ebeba76c5f6ce0c7c28 Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotTestJSON-349852722-project Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance f246716f-ca32-4078-8e7e-58f3bcc0e551 could not be found. Sep 09 15:05:38.830539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': 'f246716f-ca32-4078-8e7e-58f3bcc0e551'} Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f246716f-ca32-4078-8e7e-58f3bcc0e551 could not be found. Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:05:38.831445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f246716f-ca32-4078-8e7e-58f3bcc0e551 could not be found. Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f246716f-ca32-4078-8e7e-58f3bcc0e551 could not be found. Sep 09 15:05:38.833334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:05:38.834668 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Returning 404 to user: Instance f246716f-ca32-4078-8e7e-58f3bcc0e551 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:05:38.834668 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e423676-b3ef-4f7c-a004-e95a59c7e8ab tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551" status: 404 len: 111 microversion: 2.1 time: 0.034522 Sep 09 15:05:38.836348 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 477/943] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:38 2022] GET /compute/v2.1/servers/f246716f-ca32-4078-8e7e-58f3bcc0e551 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:05:38.855310 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-8a01068e-9242-454a-9d3d-2ad428450787 req-5cb1b94f-b383-4567-9f9e-5a823df51d2d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:38.857263 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-8a01068e-9242-454a-9d3d-2ad428450787 req-5cb1b94f-b383-4567-9f9e-5a823df51d2d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:38.857922 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-8a01068e-9242-454a-9d3d-2ad428450787 req-5cb1b94f-b383-4567-9f9e-5a823df51d2d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:38.870111 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-8a01068e-9242-454a-9d3d-2ad428450787 req-5cb1b94f-b383-4567-9f9e-5a823df51d2d service nova] Creating event network-vif-deleted:63833e34-1dcd-4b56-95f8-cb3d86459d36 for instance 46e645a9-d8ab-4371-a36e-a2d2e63c3670 on hv-cinder-82869 Sep 09 15:05:38.879385 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-8a01068e-9242-454a-9d3d-2ad428450787 req-5cb1b94f-b383-4567-9f9e-5a823df51d2d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055009 Sep 09 15:05:38.879981 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 467/944] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:05:39.341375 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:39.342000 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:39.348662 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:39.349150 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:39.349612 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:39.350305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:39.350763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:39.351194 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:39.369508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:39.384735 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:39.385234 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:39.385679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:39.386124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lazy-loading 'fault' on Instance uuid 46e645a9-d8ab-4371-a36e-a2d2e63c3670 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:05:39.432804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:39.440563 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-974e48cc-4757-4736-a9d3-70487bf7c33f tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1304 microversion: 2.1 time: 0.103051 Sep 09 15:05:39.441160 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 478/945] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:39 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:40.464541 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:40.465265 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:40.471320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:40.471798 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:40.472266 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:40.472946 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:40.473431 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:40.473853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:40.504487 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:40.504967 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:40.505430 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:40.505876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lazy-loading 'fault' on Instance uuid 46e645a9-d8ab-4371-a36e-a2d2e63c3670 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:05:40.549278 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:40.557304 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-65abd547-65bb-449e-b435-14c19dfafa15 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1304 microversion: 2.1 time: 0.097431 Sep 09 15:05:40.557858 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 468/946] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:40 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:41.580664 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:41.581232 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:41.588158 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:41.588642 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:41.589082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:41.589806 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:41.590261 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:41.590685 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:41.621420 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:41.621895 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:41.622330 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:41.622767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lazy-loading 'fault' on Instance uuid 46e645a9-d8ab-4371-a36e-a2d2e63c3670 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:05:41.663399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd32d1d55f274ac8ac7113a8f29349a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4935439b82154c548b0bfad252c407b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:41.670933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a747e2ea-35ee-4583-a74d-9766f3de190e tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 200 len: 1304 microversion: 2.1 time: 0.094193 Sep 09 15:05:41.671487 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 479/947] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:41 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:42.693347 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:42.693987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] [instance: 46e645a9-d8ab-4371-a36e-a2d2e63c3670] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:42.696849 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 15:05:42.696994 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Fri Sep 9 15:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 (ip 10.222.0.15) !!! Sep 09 15:05:42.698155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:42.705863 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:42.706835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:42.707268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:42.707982 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:42.708430 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:42.708854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:42.724846 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] HTTP exception thrown: Instance 46e645a9-d8ab-4371-a36e-a2d2e63c3670 could not be found. Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Request method failure captured: Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 HTTP/1.1 Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1Yq48t34EMfOv1mbgpSQPWU4cv8GIdV13IyYFfjLu414cJwrirVhlVkE92L5Bq2Ma4Y3LUvOT6GKw1_qNw6c-iCXiNjnLiBeWDLAACQts8UKrR5RcCirYeuuvc1jElaxXTwFysUU772hfYrsA2XT2R44GAQD6nvkobrxlGNKT-v9fo Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 4935439b82154c548b0bfad252c407b7 Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesNegativeTest-1525970058 Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:05:42.726543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4935439b82154c548b0bfad252c407b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4935439b82154c548b0bfad252c407b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4935439b82154c548b0bfad252c407b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4935439b82154c548b0bfad252c407b7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesNegativeTest-1525970058 Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 4935439b82154c548b0bfad252c407b7 Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesNegativeTest-1525970058 Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesNegativeTest-1525970058-project Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: fd32d1d55f274ac8ac7113a8f29349a0 Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesNegativeTest-1525970058-project Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 46e645a9-d8ab-4371-a36e-a2d2e63c3670 could not be found. Sep 09 15:05:42.728133 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '46e645a9-d8ab-4371-a36e-a2d2e63c3670'} Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46e645a9-d8ab-4371-a36e-a2d2e63c3670 could not be found. Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:05:42.729077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46e645a9-d8ab-4371-a36e-a2d2e63c3670 could not be found. Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46e645a9-d8ab-4371-a36e-a2d2e63c3670 could not be found. Sep 09 15:05:42.730551 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:05:42.731898 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] Returning 404 to user: Instance 46e645a9-d8ab-4371-a36e-a2d2e63c3670 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:05:42.731898 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2e7ac91a-a26a-42e1-a7ca-0e3968d60f60 tempest-VolumesNegativeTest-1525970058 tempest-VolumesNegativeTest-1525970058-project] 10.222.0.15 "GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670" status: 404 len: 111 microversion: 2.1 time: 0.038514 Sep 09 15:05:42.731898 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 469/948] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:42 2022] GET /compute/v2.1/servers/46e645a9-d8ab-4371-a36e-a2d2e63c3670 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:05:46.685471 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-621982001", "imageRef": "830bbdf5-e0b3-4602-90b3-b8feca06e02c", "flavorRef": "452", "networks": [{"uuid": "cabe1b09-87d8-4886-a7a5-9c46fbfdfcdc"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:05:46.695340 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:46.744024 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] validate_networks() for [('cabe1b09-87d8-4886-a7a5-9c46fbfdfcdc', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:05:47.358623 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:05:47.359051 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:05:47.359526 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:05:47.359936 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:05:47.360770 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:05:47.369966 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:47.370446 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:47.370885 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:47.371613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:47.372074 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:47.372496 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:47.391748 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Getting quotas for project 781a403f041b4389b804107c30ffedac. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:05:47.396392 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Getting quotas for user 33a5368bd6fb4ebeba76c5f6ce0c7c28 and project 781a403f041b4389b804107c30ffedac. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:05:47.411186 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:05:47.411820 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='830bbdf5-e0b3-4602-90b3-b8feca06e02c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:05:47.464878 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c187544b-c7fa-4512-958a-d3553d1379d8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783443 Sep 09 15:05:47.465696 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 480/949] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:05:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 15:05:47.476950 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5381033f-7cf7-4891-9a75-9e880d146e89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:47.477608 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5381033f-7cf7-4891-9a75-9e880d146e89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:47.537171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5381033f-7cf7-4891-9a75-9e880d146e89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:47.544431 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5381033f-7cf7-4891-9a75-9e880d146e89 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1218 microversion: 2.1 time: 0.071134 Sep 09 15:05:47.557674 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 470/950] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:47 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:48.567135 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:48.567762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:48.576029 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:48.576521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:48.576964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:48.577897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:48.578519 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:48.578959 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:48.677898 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:48.685695 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0660f444-37e2-417d-ae4a-9cd5f22f2122 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1288 microversion: 2.1 time: 0.122635 Sep 09 15:05:48.686439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 481/951] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:48 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1288 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:49.708637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:49.709287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:49.715599 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:49.716082 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:49.716523 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:49.717240 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:49.717732 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:49.718163 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:49.888742 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-5151a107-630d-4387-bfe4-c643ff1adad0 req-f9a8f76d-12bd-424f-8cd6-d054ad07c295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8ee68ec-32da-44b8-a532-f3f273043168", "tag": "623d00a2-9372-4ec8-94c5-533be7ee23c0"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:05:49.898491 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5151a107-630d-4387-bfe4-c643ff1adad0 req-f9a8f76d-12bd-424f-8cd6-d054ad07c295 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:49.898980 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5151a107-630d-4387-bfe4-c643ff1adad0 req-f9a8f76d-12bd-424f-8cd6-d054ad07c295 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:49.899409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5151a107-630d-4387-bfe4-c643ff1adad0 req-f9a8f76d-12bd-424f-8cd6-d054ad07c295 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:49.911175 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-5151a107-630d-4387-bfe4-c643ff1adad0 req-f9a8f76d-12bd-424f-8cd6-d054ad07c295 service nova] Creating event network-changed:623d00a2-9372-4ec8-94c5-533be7ee23c0 for instance b8ee68ec-32da-44b8-a532-f3f273043168 on hv-cinder-82869 Sep 09 15:05:49.915963 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-5151a107-630d-4387-bfe4-c643ff1adad0 req-f9a8f76d-12bd-424f-8cd6-d054ad07c295 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031686 Sep 09 15:05:49.916541 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 482/952] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:05:49.936894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:49.944985 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-15f8d40e-076a-4fbf-aad9-1a028fa2477b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.240291 Sep 09 15:05:49.945780 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 471/953] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:49 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:50.970488 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:50.971178 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:50.977854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:50.978334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:50.978766 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:50.979442 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:50.979917 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:50.980333 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:51.111354 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:51.118905 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9295f65a-1083-4c2e-8208-63b067bf8959 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.153056 Sep 09 15:05:51.119463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 483/954] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:50 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:52.141125 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:52.142335 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:52.148886 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:52.149414 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:52.149863 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:52.150568 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:52.151029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:52.151457 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:52.364808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:52.373146 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-22325e9c-5172-4896-bd10-97183dff5794 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.235877 Sep 09 15:05:52.373974 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 472/955] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:52 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:53.396309 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:53.396915 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:53.403395 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:53.403868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:53.404299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:53.404980 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:53.405453 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:53.405906 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:53.536409 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:53.543973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40a6984e-0385-4c08-95dd-989f4f834fe8 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.152015 Sep 09 15:05:53.544532 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 484/956] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:53 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:54.567058 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:54.567671 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:54.574064 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:54.574547 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:54.574991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:54.575668 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:54.576117 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:54.576612 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:54.713780 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:54.728263 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7bc3d625-ff8e-4f24-9087-92534534a9a6 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.164973 Sep 09 15:05:54.728558 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 473/957] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:54 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:05:55.750999 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:55.751615 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:55.758220 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:55.758702 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:55.759141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:55.759859 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:55.760339 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:55.760763 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:55.902645 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:55.911212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-341b1002-41da-4271-8207-e04b5c5779ce tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.164084 Sep 09 15:05:55.912062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 485/958] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:55 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:56.935940 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:56.936557 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:56.942616 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:56.943102 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:56.943541 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:56.944234 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:56.944686 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:56.945109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:57.074463 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:57.082581 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-abccd1c8-1b44-4745-a234-9df676bce3b3 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.150651 Sep 09 15:05:57.083142 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 474/959] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:56 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:58.106010 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:58.106619 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:58.109008 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:58.109683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:58.115899 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:58.116317 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:58.116749 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:58.117468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:58.117919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:58.118339 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:58.246442 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:58.254001 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20bb0f09-7a71-44e1-b5a6-df86253009c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.151865 Sep 09 15:05:58.254565 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 486/960] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:58 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:59.276208 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:05:59.276831 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:05:59.278733 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:59.285693 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:59.286272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:59.286714 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:59.287416 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:59.287877 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:59.288305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:59.425688 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:05:59.435581 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5be14951-43f4-4bc9-934c-b75da8821d41 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.163092 Sep 09 15:05:59.436524 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 475/961] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:05:59 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:05:59.546515 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-eac4449e-1453-452e-b4a3-9841b39cfa05 req-d62a3bf6-8b1a-427a-83c0-84d477369e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ee68ec-32da-44b8-a532-f3f273043168", "name": "network-vif-plugged", "status": "completed", "tag": "623d00a2-9372-4ec8-94c5-533be7ee23c0"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:05:59.557944 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-eac4449e-1453-452e-b4a3-9841b39cfa05 req-d62a3bf6-8b1a-427a-83c0-84d477369e65 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:05:59.558575 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-eac4449e-1453-452e-b4a3-9841b39cfa05 req-d62a3bf6-8b1a-427a-83c0-84d477369e65 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:05:59.559020 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-eac4449e-1453-452e-b4a3-9841b39cfa05 req-d62a3bf6-8b1a-427a-83c0-84d477369e65 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:05:59.571140 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-eac4449e-1453-452e-b4a3-9841b39cfa05 req-d62a3bf6-8b1a-427a-83c0-84d477369e65 service nova] Creating event network-vif-plugged:623d00a2-9372-4ec8-94c5-533be7ee23c0 for instance b8ee68ec-32da-44b8-a532-f3f273043168 on hv-cinder-82869 Sep 09 15:05:59.580907 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-eac4449e-1453-452e-b4a3-9841b39cfa05 req-d62a3bf6-8b1a-427a-83c0-84d477369e65 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038215 Sep 09 15:05:59.582205 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 487/962] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:06:00.458424 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:00.459038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:00.465372 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:00.465855 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:00.466309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:00.466999 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:00.467449 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:00.467870 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:00.606152 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:00.613746 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0580ea1d-1e61-4378-9441-fb76b4e6e88d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1318 microversion: 2.1 time: 0.159874 Sep 09 15:06:00.614309 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 476/963] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:00 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:01.637062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:01.637780 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:01.644355 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:01.644834 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:01.645295 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:01.645981 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:01.646427 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:01.646846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:01.775465 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:01.783256 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa659730-7571-421c-a171-03458826d2eb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1506 microversion: 2.1 time: 0.150984 Sep 09 15:06:01.783809 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 488/964] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:01 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:01.805717 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f7328d6f-164a-44fa-a878-5f376da04467 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "303d5cf4-78a8-4967-be79-30a92dc011f0", "device": "/dev/sdb"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:01.808069 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f7328d6f-164a-44fa-a878-5f376da04467 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:01.814364 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7328d6f-164a-44fa-a878-5f376da04467 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:01.814840 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7328d6f-164a-44fa-a878-5f376da04467 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:01.815796 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7328d6f-164a-44fa-a878-5f376da04467 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:01.816479 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7328d6f-164a-44fa-a878-5f376da04467 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:01.816928 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7328d6f-164a-44fa-a878-5f376da04467 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:01.817383 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7328d6f-164a-44fa-a878-5f376da04467 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:02.061540 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f7328d6f-164a-44fa-a878-5f376da04467 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "POST /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259148 Sep 09 15:06:02.062385 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 477/965] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:06:01 2022] POST /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:06:17.218773 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-860388436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-845692317", "security_groups": [{"name": "tempest-secgroup-smoke-796642502"}], "block_device_mapping_v2": [{"uuid": "091ef4ab-e796-4a6c-9af2-d08cb38d212a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "20d1d01f-8d2e-4d86-913d-da4da3df92d5"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:17.277853 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:17.282254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=54 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:17.395388 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] validate_networks() for [('20d1d01f-8d2e-4d86-913d-da4da3df92d5', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:06:17.894359 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:06:17.895275 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:06:17.895994 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:06:17.896525 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:06:17.897042 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:06:17.909316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:17.910700 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:17.911376 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:17.912446 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:17.913368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:17.913788 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:17.937098 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Getting quotas for project 515d1ca3dcd249ada56b21a0a6e3a5b9. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:06:17.943757 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Getting quotas for user 9a50fbbf18584bb1a784283e768be7a2 and project 515d1ca3dcd249ada56b21a0a6e3a5b9. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:06:18.015492 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:06:18.020363 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='091ef4ab-e796-4a6c-9af2-d08cb38d212a',volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:06:18.191393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5150e8b3-2556-44e9-8c7f-79f73ce85962 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.978512 Sep 09 15:06:18.199929 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 489/966] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:06:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 15:06:18.205934 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f48b85dc-bf76-49d8-8c86-0fef0e51b8d6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:18.207210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f48b85dc-bf76-49d8-8c86-0fef0e51b8d6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:18.209847 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=19 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:18.210709 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:18.300038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f48b85dc-bf76-49d8-8c86-0fef0e51b8d6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:18.321716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f48b85dc-bf76-49d8-8c86-0fef0e51b8d6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1093 microversion: 2.1 time: 0.110176 Sep 09 15:06:18.322909 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 478/967] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:18 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1093 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:19.359661 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:19.360884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:19.369082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:19.369082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:19.369082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:19.369788 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:19.370240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:19.370660 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:19.448987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:19.462628 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5142603-e53b-47a0-93f0-7bbd8297ca11 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1143 microversion: 2.1 time: 0.117108 Sep 09 15:06:19.463223 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 490/968] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:19 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1143 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:20.491200 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:20.492468 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:20.508574 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:20.509379 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:20.510008 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:20.510900 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:20.511854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:20.512454 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:20.634994 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:20.651445 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4971ed8b-cce2-4266-ba70-91fa33a2a5a6 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1143 microversion: 2.1 time: 0.170916 Sep 09 15:06:20.652603 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 479/969] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:20 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1143 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:21.677629 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:21.678798 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:21.686310 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:21.686694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:21.687135 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:21.687839 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:21.688297 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:21.688721 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:21.776111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:21.788240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9690e9b5-5fd6-4b3c-a972-6eac6caf3d00 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1191 microversion: 2.1 time: 0.115312 Sep 09 15:06:21.788991 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 491/970] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:21 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:22.811266 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:22.812537 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:22.825824 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:22.826651 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:22.827327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:22.828283 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:22.831435 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:22.835507 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:23.174014 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:23.191370 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-59580a6a-244c-4d0a-a2d5-f9e311a16848 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.383842 Sep 09 15:06:23.193885 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 480/971] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:22 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:23.952563 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-8e7f2298-9ed1-4e3b-b676-d288a336fd94 req-e420d393-448d-412f-9804-6a085ca541db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba28ee63-2458-4bd0-9e99-e6723db42836", "tag": "6bfea242-79c3-46c1-8ac9-c52dba84bb9f"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:23.970683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-8e7f2298-9ed1-4e3b-b676-d288a336fd94 req-e420d393-448d-412f-9804-6a085ca541db service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:23.974100 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-8e7f2298-9ed1-4e3b-b676-d288a336fd94 req-e420d393-448d-412f-9804-6a085ca541db service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:23.974745 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-8e7f2298-9ed1-4e3b-b676-d288a336fd94 req-e420d393-448d-412f-9804-6a085ca541db service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:23.990825 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-8e7f2298-9ed1-4e3b-b676-d288a336fd94 req-e420d393-448d-412f-9804-6a085ca541db service nova] Creating event network-changed:6bfea242-79c3-46c1-8ac9-c52dba84bb9f for instance ba28ee63-2458-4bd0-9e99-e6723db42836 on hv-cinder-82869 Sep 09 15:06:23.996546 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-8e7f2298-9ed1-4e3b-b676-d288a336fd94 req-e420d393-448d-412f-9804-6a085ca541db service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056989 Sep 09 15:06:23.997837 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 492/972] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:06:24.218021 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:24.220210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:24.230303 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:24.231069 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:24.231712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:24.232664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:24.233673 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:24.234177 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:24.715790 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:24.727107 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f0449ad4-a6f6-402e-8647-73d177fa4a44 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.513764 Sep 09 15:06:24.727844 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 481/973] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:24 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:25.183808 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:25.184393 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:25.191431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:25.192129 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:25.192707 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:25.193374 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:25.193836 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:25.194264 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:25.287205 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e413ddbc-f08a-4073-9c0f-908b89403f15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Action: 'create', calling method: .version_select at 0x7f8ad25d6ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1418068583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGWdl7LllxebJaEun2xvXEyqs7I4s+yOHb0BwJKwJq/iEdVv9Ip4S/osZ03uhBJKmjoWXPFErsj3WFQFTWAKCYSBcfm1KncEi2csJi2PvrrN6M/sJXGYnTa3YvaAGGXQQ=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:25.289933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'services' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:25.304183 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-e413ddbc-f08a-4073-9c0f-908b89403f15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Getting quotas for project ee3a90f56942438a887a45157622532f. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:06:25.309287 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-e413ddbc-f08a-4073-9c0f-908b89403f15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Getting quotas for user a0c64b4ade2e4fdda31999e89e307980 and project ee3a90f56942438a887a45157622532f. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:06:25.324093 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e413ddbc-f08a-4073-9c0f-908b89403f15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [370692a8-0d08-4b91-8a3b-f2eb7655c4e9] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 15:06:25.364652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e313596b-8d5b-4bcb-a32c-ddcbc5d7df7c tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168/os-volume_attachments/303d5cf4-78a8-4967-be79-30a92dc011f0" status: 202 len: 0 microversion: 2.1 time: 0.185393 Sep 09 15:06:25.365384 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 493/974] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:06:25 2022] DELETE /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168/os-volume_attachments/303d5cf4-78a8-4967-be79-30a92dc011f0 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:06:25.758400 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:25.759022 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:25.765182 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:25.765700 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:25.766135 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:25.766826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:25.767285 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:25.767761 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:25.908067 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:25.917174 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49fc150b-69db-44c6-9f22-2ca932438e61 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.170456 Sep 09 15:06:25.917760 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 494/975] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:25 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:26.331677 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [None req-e413ddbc-f08a-4073-9c0f-908b89403f15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [370692a8-0d08-4b91-8a3b-f2eb7655c4e9] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 46092. Sep 09 15:06:26.345373 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e413ddbc-f08a-4073-9c0f-908b89403f15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.062494 Sep 09 15:06:26.346637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 482/976] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 15:06:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:06:26.395759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1503041690", "imageRef": "edf7ebb8-f6ba-450a-9d08-ac5b35a2f783", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1418068583", "networks": [{"uuid": "d1303b57-e7de-4c0f-8024-6e5319354796"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:26.448834 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] validate_networks() for [('d1303b57-e7de-4c0f-8024-6e5319354796', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 15:06:26.490071 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:26.490696 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:26.497459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:26.498010 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:26.498531 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:26.499282 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:26.499806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:26.500295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:26.524806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:06:26.605591 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d884b315-bd23-42e4-b70c-ccefefb97e92 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 204 len: 0 microversion: 2.1 time: 0.118669 Sep 09 15:06:26.606427 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 483/977] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:06:26 2022] DELETE /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 15:06:26.614799 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:26.615556 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:26.621777 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:26.622267 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:26.622708 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:26.623412 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:26.623873 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:26.624304 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:26.851545 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:26.859472 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-36a5cfc5-4d0b-4b11-928e-b07de51e9706 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1512 microversion: 2.1 time: 0.248660 Sep 09 15:06:26.859974 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 484/978] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:26 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:26.892558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 15:06:26.893601 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 15:06:26.894076 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 15:06:26.894510 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 15:06:26.894973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 15:06:26.903759 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:26.904235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:26.904664 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:26.905424 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:26.905885 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:26.906303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:26.922513 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Getting quotas for project ee3a90f56942438a887a45157622532f. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 15:06:26.926882 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Getting quotas for user a0c64b4ade2e4fdda31999e89e307980 and project ee3a90f56942438a887a45157622532f. Resources: {'ram', 'cores', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 15:06:26.937942 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 15:06:26.940670 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:26.940807 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='edf7ebb8-f6ba-450a-9d08-ac5b35a2f783',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 15:06:26.941443 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:26.947338 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:26.947905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:26.948402 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:26.949152 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:26.949691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:26.950180 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:26.986178 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7853fb34-d999-483b-b8f2-a366e295473d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594677 Sep 09 15:06:26.987619 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 495/979] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 15:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 15:06:26.998358 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3174ca20-59f9-4ddf-a3b1-d59b6596050a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:26.998976 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3174ca20-59f9-4ddf-a3b1-d59b6596050a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:27.082628 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3174ca20-59f9-4ddf-a3b1-d59b6596050a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:27.090303 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3174ca20-59f9-4ddf-a3b1-d59b6596050a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1259 microversion: 2.1 time: 0.095255 Sep 09 15:06:27.090930 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 496/980] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:26 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1259 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:27.112402 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:27.120205 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a44b0e6d-f39e-4f50-97d4-7802802108d9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.184206 Sep 09 15:06:27.120772 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 485/981] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:26 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:27.881482 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:27.882094 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:27.888526 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:27.889007 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:27.889473 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:27.890158 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:27.890605 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:27.891023 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:28.019998 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:28.028088 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-164dad34-a43c-465f-95d8-75493a2d60c2 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1512 microversion: 2.1 time: 0.150694 Sep 09 15:06:28.028657 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 497/982] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:27 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:28.112011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:28.112867 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:28.120758 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:28.121285 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:28.121730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:28.122438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:28.122905 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:28.123337 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:28.144171 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:28.144706 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:28.150625 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:28.151111 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:28.151550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:28.152243 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:28.152700 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:28.153124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:28.193994 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:28.201683 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8b1c9a18-8cef-4404-8b77-82e925631dc5 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1255 microversion: 2.1 time: 0.093520 Sep 09 15:06:28.202262 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 486/983] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:28 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1255 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:28.291817 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:28.299771 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-502e97a9-837b-4f99-bf8d-cd3f9e312218 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.160242 Sep 09 15:06:28.300335 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 498/984] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:28 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:28.838109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-503c2b9d-1e69-4ca0-b27c-15d50bef4dfa req-deb16025-c1f1-41b8-8576-0c4f36d75688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ee68ec-32da-44b8-a532-f3f273043168", "name": "network-vif-deleted", "tag": "623d00a2-9372-4ec8-94c5-533be7ee23c0"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:28.848661 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-503c2b9d-1e69-4ca0-b27c-15d50bef4dfa req-deb16025-c1f1-41b8-8576-0c4f36d75688 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:28.849833 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-503c2b9d-1e69-4ca0-b27c-15d50bef4dfa req-deb16025-c1f1-41b8-8576-0c4f36d75688 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:28.849833 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-503c2b9d-1e69-4ca0-b27c-15d50bef4dfa req-deb16025-c1f1-41b8-8576-0c4f36d75688 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:28.862237 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-503c2b9d-1e69-4ca0-b27c-15d50bef4dfa req-deb16025-c1f1-41b8-8576-0c4f36d75688 service nova] Creating event network-vif-deleted:623d00a2-9372-4ec8-94c5-533be7ee23c0 for instance b8ee68ec-32da-44b8-a532-f3f273043168 on hv-cinder-82869 Sep 09 15:06:28.869985 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-503c2b9d-1e69-4ca0-b27c-15d50bef4dfa req-deb16025-c1f1-41b8-8576-0c4f36d75688 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035598 Sep 09 15:06:28.871429 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 487/985] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:06:29.052387 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:29.053062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:29.059586 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:29.060212 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:29.060733 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:29.062012 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:29.062012 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:29.062386 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:29.107822 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:29.108305 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:29.108830 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:29.109718 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:29.159800 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:29.170468 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af805a6b-9acb-4c5b-b18b-7991465f3fcb tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1308 microversion: 2.1 time: 0.122466 Sep 09 15:06:29.171188 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 499/986] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:29 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1308 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:29.226819 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:29.227520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:29.233984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:29.234696 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:29.235355 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:29.236268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:29.236807 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:29.237253 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:29.318226 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:29.324679 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:29.325261 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:29.334119 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ea1f565a-2977-4d09-9174-6e18f4c4e4f8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1317 microversion: 2.1 time: 0.110003 Sep 09 15:06:29.335185 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 488/987] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:29 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1317 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:29.348698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:29.348698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:29.348698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:29.348698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:29.349093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:29.349093 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:29.659961 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:29.670517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d85b3fda-9a28-46ee-9666-e1098274ae2d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.349585 Sep 09 15:06:29.671734 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 500/988] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:29 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:30.194765 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:30.195482 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:30.201601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:30.202152 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:30.202664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:30.203425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:30.203964 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:30.204461 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:30.239925 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:30.240680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:30.240840 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:30.241315 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:30.286437 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:30.294397 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3667f6ef-733f-4590-b28c-846ba2cc7355 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1308 microversion: 2.1 time: 0.103532 Sep 09 15:06:30.294980 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 489/989] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:30 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:30.363940 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:30.364545 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:30.371484 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:30.372044 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:30.372591 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:30.373418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:30.373898 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:30.374343 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:30.527053 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:30.535523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1cb6cbf8-d098-485e-b8ad-0f5b6e72d3db tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.175592 Sep 09 15:06:30.536134 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 501/990] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:30 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:30.695680 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:30.696576 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:30.702758 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:30.703324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:30.703860 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:30.704632 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:30.705234 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:30.705737 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:30.846236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:30.854188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed8ce267-c63e-43ec-9923-ad1b9a40d8b9 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.162427 Sep 09 15:06:30.854768 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 490/991] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:30 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:31.318012 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:31.318622 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:31.325015 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:31.325531 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:31.325967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:31.326919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:31.327568 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:31.328055 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:31.360712 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:31.361209 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:31.362299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:31.362769 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:31.404024 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:31.412910 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14e620f1-a971-456b-a017-050d45d288df tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1308 microversion: 2.1 time: 0.098697 Sep 09 15:06:31.413527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 502/992] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:31 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:31.559413 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:31.560225 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:31.566970 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:31.567459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:31.567896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:31.568648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:31.569051 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:31.569506 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:31.715894 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:31.725528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-344e4e64-ede6-40aa-8ec6-e4948bec6039 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.170465 Sep 09 15:06:31.726280 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 491/993] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:31 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:31.878509 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:31.879141 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:31.886046 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:31.886539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:31.886975 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:31.887712 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:31.888173 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:31.888596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:32.047919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:32.056001 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25921b97-ed78-4bdc-8026-867fd26c2498 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.182178 Sep 09 15:06:32.056771 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 503/994] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:31 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:32.438659 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:32.440039 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:32.446466 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:32.446949 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:32.447393 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:32.448102 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:32.448589 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:32.449019 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:32.485330 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:32.485848 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:32.486786 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:32.487239 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:32.529036 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:32.537635 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8acffd07-2057-4952-9a71-785b08fb7575 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1308 microversion: 2.1 time: 0.105113 Sep 09 15:06:32.538626 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 492/995] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:32 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:32.747919 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:32.748473 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:32.754552 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:32.755035 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:32.755469 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:32.756152 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:32.756917 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:32.757287 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:32.896834 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:32.904983 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-df172f44-8b1c-459e-9485-194a5836dad0 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.160896 Sep 09 15:06:32.905592 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 504/996] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:32 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:33.079268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:33.080746 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:33.087443 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:33.087950 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:33.088394 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:33.089109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:33.089595 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:33.090032 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:33.233761 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:33.241660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-047fd17f-39a5-4e85-81d7-dc76770557d4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.166595 Sep 09 15:06:33.250660 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 493/997] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:33 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:33.562130 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:33.562742 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:33.569247 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:33.569741 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:33.570177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:33.570871 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:33.571322 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:33.571747 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:33.604334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:33.604828 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:33.605398 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:33.605819 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:33.649873 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:33.658753 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01f67372-699d-4ce8-b9c9-cf8f8f5c7f2d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1308 microversion: 2.1 time: 0.100415 Sep 09 15:06:33.659619 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 505/998] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:33 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:33.928567 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:33.929295 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:33.935601 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:33.936095 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:33.936532 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:33.937284 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:33.937730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:33.938154 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:34.126784 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:34.133333 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:34.136131 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-942a8c39-d5f9-4798-ab38-f111906a5898 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.211360 Sep 09 15:06:34.149700 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 494/999] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:33 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:34.264197 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:34.264797 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:34.271483 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:34.271971 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:34.272404 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:34.273096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:34.273577 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:34.274073 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:34.413991 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:34.417925 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:34.423538 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3315283-2c90-49aa-a059-68fd389372af tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.163170 Sep 09 15:06:34.424872 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 506/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:34 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:34.682420 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:34.682983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:34.689913 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:34.690324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:34.690784 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:34.691438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:34.691898 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:34.692321 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:34.727109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:34.727594 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:34.728026 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:34.728469 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:34.770318 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:34.778320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cbcc4201-7462-4379-85b2-1943e407e8d9 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1308 microversion: 2.1 time: 0.100124 Sep 09 15:06:34.778901 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 495/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:34 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:35.162905 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:35.163523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:35.171177 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:35.171703 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:35.172151 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:35.172860 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:35.173346 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:35.174399 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:35.323517 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:35.341480 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc642df8-85d2-4e8c-84bb-ec5fe22ad925 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.182805 Sep 09 15:06:35.342502 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 507/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:35 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:35.447200 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:35.447806 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:35.450130 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:35.456200 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:35.456690 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:35.457123 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:35.457840 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:35.458300 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:35.458721 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:35.602115 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:35.611466 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-46539887-58c4-4da4-a723-d93b69718b57 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.168072 Sep 09 15:06:35.612179 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 496/1003] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:35 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:35.802361 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:35.803418 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:35.810172 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:35.810662 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:35.811096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:35.811805 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:35.812257 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:35.812704 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:35.847565 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:35.848087 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:35.848521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:35.848967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:35.896999 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:35.905370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e269f97c-d21c-4f0c-b3f8-3c9031e8055d tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1308 microversion: 2.1 time: 0.106707 Sep 09 15:06:35.906748 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 508/1004] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:35 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:36.364669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:36.365210 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:36.371291 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:36.371779 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:36.372212 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:36.372904 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:36.373389 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:36.373809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:36.511517 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:36.519330 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f51a0e48-5089-4215-a356-85879ccef63a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.159229 Sep 09 15:06:36.519896 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 497/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:36 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:36.636004 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:36.636630 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:36.643406 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:36.643899 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:36.644463 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:36.645577 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:36.646045 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:36.646590 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:36.780443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:36.790169 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b86c6cc-a822-479c-8f74-8bf11ae7e593 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.158084 Sep 09 15:06:36.790740 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 509/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:36 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:36.928112 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:36.928684 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:36.934641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:36.935120 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:36.935556 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:36.936246 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:36.936700 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:36.937128 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:36.967159 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:36.967631 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:36.968067 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:36.968507 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:37.011392 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:37.019686 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9799adae-042b-4be3-93d4-394b8ed197af tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1308 microversion: 2.1 time: 0.095439 Sep 09 15:06:37.020268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 498/1007] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:36 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:37.542933 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:37.543545 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:37.545492 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:37.546541 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=14 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:37.552521 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:37.553013 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:37.553484 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:37.554180 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:37.554633 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:37.555054 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:37.786257 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:37.793973 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6706a552-c578-4a8b-885e-f04e85e9babf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.254906 Sep 09 15:06:37.794549 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 510/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:37 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:37.812174 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:37.812797 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:37.819164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:37.819653 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:37.820090 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:37.820787 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:37.821297 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:37.821726 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:38.044172 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:38.044828 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:38.052558 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:38.053063 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:38.053533 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:38.054251 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:38.054709 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:38.055677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:38.063934 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:38.071987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-64660425-617d-4971-adaf-7e7c2d6de50d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.263585 Sep 09 15:06:38.086452 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 499/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:37 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:38.105068 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:38.105767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:38.106301 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:38.106946 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lazy-loading 'fault' on Instance uuid b8ee68ec-32da-44b8-a532-f3f273043168 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:06:38.162878 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a5368bd6fb4ebeba76c5f6ce0c7c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781a403f041b4389b804107c30ffedac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:38.170005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c348a0a-6882-4066-9614-f56760456687 tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 200 len: 1308 microversion: 2.1 time: 0.130627 Sep 09 15:06:38.170507 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 511/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:38 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:38.305046 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-78a14b1a-7239-4ec9-b398-1b9c48644fdd req-7873e259-c74d-4bb7-a48b-cae74cf2dc6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db254b5c-e7fd-4f78-85a8-263d61d4f983", "tag": "92661755-b8dc-4b7c-99d8-a069f1628575"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:38.315536 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-78a14b1a-7239-4ec9-b398-1b9c48644fdd req-7873e259-c74d-4bb7-a48b-cae74cf2dc6f service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:38.316099 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-78a14b1a-7239-4ec9-b398-1b9c48644fdd req-7873e259-c74d-4bb7-a48b-cae74cf2dc6f service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:38.316766 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-78a14b1a-7239-4ec9-b398-1b9c48644fdd req-7873e259-c74d-4bb7-a48b-cae74cf2dc6f service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:38.328268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-78a14b1a-7239-4ec9-b398-1b9c48644fdd req-7873e259-c74d-4bb7-a48b-cae74cf2dc6f service nova] Creating event network-changed:92661755-b8dc-4b7c-99d8-a069f1628575 for instance db254b5c-e7fd-4f78-85a8-263d61d4f983 on hv-cinder-82869 Sep 09 15:06:38.333609 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-78a14b1a-7239-4ec9-b398-1b9c48644fdd req-7873e259-c74d-4bb7-a48b-cae74cf2dc6f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032405 Sep 09 15:06:38.334234 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 500/1011] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:06:38.818000 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:38.818608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:38.825014 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:38.825522 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:38.825956 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:38.826647 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:38.827096 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:38.827516 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:38.955062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:38.962648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2184fb2f-bdd7-4da5-bd2a-7277cfe5e456 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.149151 Sep 09 15:06:38.963206 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 512/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:38 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:39.102139 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:39.102854 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:39.109090 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:39.109613 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:39.110060 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:39.110761 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:39.111225 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:39.111657 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:39.195321 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:39.195720 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] [instance: b8ee68ec-32da-44b8-a532-f3f273043168] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:39.205057 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:39.205551 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:39.206118 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:39.207056 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:39.207516 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:39.207948 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:39.223550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] HTTP exception thrown: Instance b8ee68ec-32da-44b8-a532-f3f273043168 could not be found. Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Request method failure captured: Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 HTTP/1.1 Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1YCnGXnclySUswqkxj-18l0DY9vwmerlmNpheOkX_b_ny7t5IROkc6nagW3b0j37EH-hntJWZpdgkq18AxQVXWLuX1RaxVRLB2ePdY5NMJGsP8y_Ub0MvyMRgCS4JB4rKWbUKrrbq6VumbqTSUe1S4zrDaWHtILuTl7Bfqh2CNEmcY Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 781a403f041b4389b804107c30ffedac Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotTestJSON-349852722 Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:06:39.225250 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/781a403f041b4389b804107c30ffedac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/781a403f041b4389b804107c30ffedac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/781a403f041b4389b804107c30ffedac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_781a403f041b4389b804107c30ffedac", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotTestJSON-349852722 Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 781a403f041b4389b804107c30ffedac Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-349852722 Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotTestJSON-349852722-project Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 33a5368bd6fb4ebeba76c5f6ce0c7c28 Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotTestJSON-349852722-project Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance b8ee68ec-32da-44b8-a532-f3f273043168 could not be found. Sep 09 15:06:39.226868 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': 'b8ee68ec-32da-44b8-a532-f3f273043168'} Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8ee68ec-32da-44b8-a532-f3f273043168 could not be found. Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:06:39.227762 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8ee68ec-32da-44b8-a532-f3f273043168 could not be found. Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8ee68ec-32da-44b8-a532-f3f273043168 could not be found. Sep 09 15:06:39.229350 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:06:39.230596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] Returning 404 to user: Instance b8ee68ec-32da-44b8-a532-f3f273043168 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:06:39.230596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a06ee9fd-020d-4f60-852b-18ec1195eb6b tempest-VolumesSnapshotTestJSON-349852722 tempest-VolumesSnapshotTestJSON-349852722-project] 10.222.0.15 "GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168" status: 404 len: 111 microversion: 2.1 time: 0.038668 Sep 09 15:06:39.230596 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 513/1013] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:39 2022] GET /compute/v2.1/servers/b8ee68ec-32da-44b8-a532-f3f273043168 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 15:06:39.246199 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:39.254505 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-102aba4f-bc31-43ec-a668-6f1307a3709e tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.157176 Sep 09 15:06:39.255079 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 501/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:39 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:39.985368 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:39.986027 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:39.992500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:39.992986 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:39.993453 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:39.994264 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:39.994742 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:39.995547 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:40.132223 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:40.140124 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b097aa0-7d50-4843-a048-0f08b0f0c28a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.158679 Sep 09 15:06:40.140726 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 514/1015] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:39 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:40.277004 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:40.277597 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:40.284221 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:40.284707 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:40.285149 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:40.285868 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:40.286327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:40.286752 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:40.668011 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:40.676282 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bc181525-5753-4bb6-b6e0-761ba5d9176c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.403194 Sep 09 15:06:40.676855 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 502/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:40 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:41.164116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:41.165459 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:41.171971 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:41.172460 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:41.172904 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:41.173638 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:41.174100 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:41.174626 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:41.299207 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:41.306814 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4d0cfa0-c74a-4b04-b97f-c3252e4c5be6 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.146878 Sep 09 15:06:41.307382 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 515/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:41 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:41.701575 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:41.702191 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:41.709494 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:41.709984 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:41.710453 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:41.711152 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:41.711612 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:41.712038 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:41.843321 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:41.850992 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-816d6f2a-822d-4a0e-924e-ad6915967d52 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.153251 Sep 09 15:06:41.851564 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 503/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:41 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:42.330508 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:42.331691 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:42.335116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:42.339571 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:42.340061 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:42.340501 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:42.341220 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:42.341672 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:42.342099 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:42.466803 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:42.474470 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10570b16-8f33-4ac2-9d4e-46409fad3421 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.147873 Sep 09 15:06:42.475034 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 516/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:42 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:42.850243 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-ebd63698-7e7b-4d8f-8ba8-32e3e3fce94d req-6f462e9a-aa52-4b4e-8c7c-8b5f8901eac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba28ee63-2458-4bd0-9e99-e6723db42836", "name": "network-vif-plugged", "status": "completed", "tag": "6bfea242-79c3-46c1-8ac9-c52dba84bb9f"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:42.859788 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-ebd63698-7e7b-4d8f-8ba8-32e3e3fce94d req-6f462e9a-aa52-4b4e-8c7c-8b5f8901eac4 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:42.860257 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-ebd63698-7e7b-4d8f-8ba8-32e3e3fce94d req-6f462e9a-aa52-4b4e-8c7c-8b5f8901eac4 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:42.860672 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-ebd63698-7e7b-4d8f-8ba8-32e3e3fce94d req-6f462e9a-aa52-4b4e-8c7c-8b5f8901eac4 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:42.872997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-ebd63698-7e7b-4d8f-8ba8-32e3e3fce94d req-6f462e9a-aa52-4b4e-8c7c-8b5f8901eac4 service nova] Creating event network-vif-plugged:6bfea242-79c3-46c1-8ac9-c52dba84bb9f for instance ba28ee63-2458-4bd0-9e99-e6723db42836 on hv-cinder-82869 Sep 09 15:06:42.874038 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:42.874855 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:42.879433 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-ebd63698-7e7b-4d8f-8ba8-32e3e3fce94d req-6f462e9a-aa52-4b4e-8c7c-8b5f8901eac4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032939 Sep 09 15:06:42.880982 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 504/1020] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:06:42.881854 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:42.882356 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:42.882801 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:42.883514 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:42.884003 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:42.884410 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:43.014316 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:43.022051 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a81c57a6-ba5f-4dd9-a7c0-9d612db38636 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.153018 Sep 09 15:06:43.022621 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 517/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:42 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:43.497213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:43.497910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:43.504917 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:43.505428 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:43.505871 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:43.506565 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:43.507013 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:43.507429 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:43.638731 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:43.646657 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-593ee1a3-cd50-4077-9792-777456eaa3b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.153635 Sep 09 15:06:43.647299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 505/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:43 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:44.045652 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:44.046324 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:44.053259 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:44.053746 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:44.054183 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:44.054880 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:44.055333 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:44.055756 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:44.189606 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:44.197270 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15026037-b112-46fd-9206-b6fdcfb6c32c tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1264 microversion: 2.1 time: 0.155523 Sep 09 15:06:44.197839 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 518/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:44 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:44.669951 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:44.670566 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:44.676910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:44.677425 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:44.677862 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:44.678546 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:44.678997 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:44.679418 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:44.804830 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:44.812430 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-69dc995f-d048-4f06-b077-62ec0d0ab2e9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.146389 Sep 09 15:06:44.812991 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 506/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:44 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:45.220082 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:45.220698 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:45.227489 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:45.228100 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:45.228567 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:45.229488 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:45.229981 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:45.230353 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:45.363515 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:45.371260 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91e8adfb-75be-4b24-b24b-db790dc14702 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1452 microversion: 2.1 time: 0.155161 Sep 09 15:06:45.371831 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 519/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:45 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:45.392920 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:45.393589 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:45.399502 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:45.399993 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:45.400430 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:45.401126 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:45.401644 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:45.402077 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:45.533127 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:45.541220 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8c3d4d32-68ba-488e-b12c-56657bc10a91 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1452 microversion: 2.1 time: 0.152120 Sep 09 15:06:45.541783 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 507/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:45 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:45.791240 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-58349869-6e1b-49a7-9263-02a17e958ac9 req-49f4f757-23ad-4ab9-97f8-ba9f7613f4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db254b5c-e7fd-4f78-85a8-263d61d4f983", "name": "network-vif-plugged", "status": "completed", "tag": "92661755-b8dc-4b7c-99d8-a069f1628575"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:45.801403 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-58349869-6e1b-49a7-9263-02a17e958ac9 req-49f4f757-23ad-4ab9-97f8-ba9f7613f4d9 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:45.802017 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-58349869-6e1b-49a7-9263-02a17e958ac9 req-49f4f757-23ad-4ab9-97f8-ba9f7613f4d9 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:45.802515 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-58349869-6e1b-49a7-9263-02a17e958ac9 req-49f4f757-23ad-4ab9-97f8-ba9f7613f4d9 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:45.815516 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-58349869-6e1b-49a7-9263-02a17e958ac9 req-49f4f757-23ad-4ab9-97f8-ba9f7613f4d9 service nova] Creating event network-vif-plugged:92661755-b8dc-4b7c-99d8-a069f1628575 for instance db254b5c-e7fd-4f78-85a8-263d61d4f983 on hv-cinder-82869 Sep 09 15:06:45.820541 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-58349869-6e1b-49a7-9263-02a17e958ac9 req-49f4f757-23ad-4ab9-97f8-ba9f7613f4d9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033083 Sep 09 15:06:45.821523 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 520/1027] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:06:45.835406 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:45.836716 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:45.843118 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:45.843857 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:45.844532 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:45.845431 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:45.846039 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:45.847330 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:46.131426 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:46.140055 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-164b8c3f-c101-425d-8b44-c2848e31cd29 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.308939 Sep 09 15:06:46.140641 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 508/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:45 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:47.165703 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:47.166398 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:47.174219 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:47.175725 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:47.176333 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:47.177420 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:47.178036 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:47.179292 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:47.397692 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:47.405546 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d5827e0-a478-47a5-944a-8eb181cc2b13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1359 microversion: 2.1 time: 0.244759 Sep 09 15:06:47.406119 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 521/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:47 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:06:47.571828 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-cec64408-add8-4600-9952-8a4e8662cd96 req-0bb3d272-e7f2-45f7-96a0-3a5589375454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba28ee63-2458-4bd0-9e99-e6723db42836", "tag": "6bfea242-79c3-46c1-8ac9-c52dba84bb9f"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:47.589057 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-cec64408-add8-4600-9952-8a4e8662cd96 req-0bb3d272-e7f2-45f7-96a0-3a5589375454 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:47.591469 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-cec64408-add8-4600-9952-8a4e8662cd96 req-0bb3d272-e7f2-45f7-96a0-3a5589375454 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:47.592585 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-cec64408-add8-4600-9952-8a4e8662cd96 req-0bb3d272-e7f2-45f7-96a0-3a5589375454 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:47.610307 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-cec64408-add8-4600-9952-8a4e8662cd96 req-0bb3d272-e7f2-45f7-96a0-3a5589375454 service nova] Creating event network-changed:6bfea242-79c3-46c1-8ac9-c52dba84bb9f for instance ba28ee63-2458-4bd0-9e99-e6723db42836 on hv-cinder-82869 Sep 09 15:06:47.618079 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-cec64408-add8-4600-9952-8a4e8662cd96 req-0bb3d272-e7f2-45f7-96a0-3a5589375454 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050079 Sep 09 15:06:47.618929 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 509/1030] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:06:48.428070 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:48.428685 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:48.435608 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:48.436032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:48.436484 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:48.437185 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:48.437663 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:48.438172 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:48.578613 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:48.586914 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-242705c0-067d-4683-9031-fdb25a884c6a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1549 microversion: 2.1 time: 0.162813 Sep 09 15:06:48.587491 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 522/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:48 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:48.609272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:48.610068 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:48.612541 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:48.618087 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:48.618571 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:48.619003 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:48.619691 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:48.620138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:48.620565 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:48.755403 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:48.763059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5a35451b-bae7-4dee-ba5b-f3233d7fcaea tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1549 microversion: 2.1 time: 0.158004 Sep 09 15:06:48.763630 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 510/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:48 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:48.785377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:48.790416 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:48.791147 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Searching by: {'deleted': False, 'project_id': 'ee3a90f56942438a887a45157622532f'} {{(pid=120643) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 15:06:48.797826 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:48.798298 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:48.798729 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:48.799443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:48.800389 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:48.800809 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:48.889294 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.multi_cell_list [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 15:06:48.966552 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:48.985602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ab88502-e7fe-4d38-b4bd-971e9f5cc99d tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204555 Sep 09 15:06:48.986193 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 523/1033] 10.222.0.15 () {58 vars in 1125 bytes} [Fri Sep 9 15:06:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:06:48.998455 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:06:48.999070 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:49.005779 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:49.006261 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:49.006694 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:49.007380 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:49.007830 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:49.008251 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:49.137459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:06:49.145162 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-08d0ddad-4caa-44ae-8671-168c55377a13 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1549 microversion: 2.1 time: 0.150821 Sep 09 15:06:49.145756 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 511/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:06:48 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:06:52.975841 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-065fb71e-a302-4691-9217-abf610fcb0b7 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97fe0c49-8dd0-40b2-8281-7c7fa2171d0b"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:06:52.978156 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-065fb71e-a302-4691-9217-abf610fcb0b7 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:06:52.984476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065fb71e-a302-4691-9217-abf610fcb0b7 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:52.984955 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065fb71e-a302-4691-9217-abf610fcb0b7 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:52.985424 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065fb71e-a302-4691-9217-abf610fcb0b7 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:52.986107 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065fb71e-a302-4691-9217-abf610fcb0b7 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:06:52.986556 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065fb71e-a302-4691-9217-abf610fcb0b7 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:06:52.986995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065fb71e-a302-4691-9217-abf610fcb0b7 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:06:53.222235 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-065fb71e-a302-4691-9217-abf610fcb0b7 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "POST /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250226 Sep 09 15:06:53.222922 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 524/1035] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 15:06:52 2022] POST /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:07:00.823223 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:00.823865 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:00.826131 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:00.826831 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=94 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:00.832244 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:00.832730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:00.833171 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:00.833916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:00.834372 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:00.834802 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:00.962047 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:00.970267 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b4908b76-c5b0-4cf5-9f7b-30f91b50e455 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1595 microversion: 2.1 time: 0.150824 Sep 09 15:07:00.970841 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 512/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:00 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1595 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:02.986751 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:02.987769 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=16 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:02.992540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-36e74745-fb53-4d33-8321-f8e0f5487ea7 req-1b813b5d-257e-4423-ac54-193f2b5068cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db254b5c-e7fd-4f78-85a8-263d61d4f983", "tag": "92661755-b8dc-4b7c-99d8-a069f1628575"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:07:03.003739 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-36e74745-fb53-4d33-8321-f8e0f5487ea7 req-1b813b5d-257e-4423-ac54-193f2b5068cf service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:03.004561 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-36e74745-fb53-4d33-8321-f8e0f5487ea7 req-1b813b5d-257e-4423-ac54-193f2b5068cf service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:03.005001 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-36e74745-fb53-4d33-8321-f8e0f5487ea7 req-1b813b5d-257e-4423-ac54-193f2b5068cf service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:03.034191 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-36e74745-fb53-4d33-8321-f8e0f5487ea7 req-1b813b5d-257e-4423-ac54-193f2b5068cf service nova] Creating event network-changed:92661755-b8dc-4b7c-99d8-a069f1628575 for instance db254b5c-e7fd-4f78-85a8-263d61d4f983 on hv-cinder-82869 Sep 09 15:07:03.040733 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-36e74745-fb53-4d33-8321-f8e0f5487ea7 req-1b813b5d-257e-4423-ac54-193f2b5068cf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056059 Sep 09 15:07:03.042329 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 525/1037] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:07:04.457490 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2138769378"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:07:04.458124 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:04.465685 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:04.466247 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:04.466778 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:04.467712 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:04.468166 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:04.468916 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:04.603188 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.network.security_group_api [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Adding security group 92310644-556d-4b4c-95bf-8bf9e31e6b85 to port 92661755-b8dc-4b7c-99d8-a069f1628575 Sep 09 15:07:04.918333 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4b96a3a6-e1b6-4289-9c1d-e240e490dc66 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "POST /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/action" status: 202 len: 0 microversion: 2.1 time: 0.464841 Sep 09 15:07:04.919508 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 513/1038] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:07:04 2022] POST /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:07:04.927967 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:04.928816 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:04.935764 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:04.936366 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:04.936968 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:04.937837 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:04.938436 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:04.938955 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:05.063518 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-faab9006-dcb4-448d-9537-5541bc1030cc req-3c2f5e50-2cfb-4ced-a7bb-b8599131d61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db254b5c-e7fd-4f78-85a8-263d61d4f983", "tag": "92661755-b8dc-4b7c-99d8-a069f1628575"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:07:05.073838 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-faab9006-dcb4-448d-9537-5541bc1030cc req-3c2f5e50-2cfb-4ced-a7bb-b8599131d61d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:05.074320 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-faab9006-dcb4-448d-9537-5541bc1030cc req-3c2f5e50-2cfb-4ced-a7bb-b8599131d61d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:05.075186 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-faab9006-dcb4-448d-9537-5541bc1030cc req-3c2f5e50-2cfb-4ced-a7bb-b8599131d61d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:05.088022 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-faab9006-dcb4-448d-9537-5541bc1030cc req-3c2f5e50-2cfb-4ced-a7bb-b8599131d61d service nova] Creating event network-changed:92661755-b8dc-4b7c-99d8-a069f1628575 for instance db254b5c-e7fd-4f78-85a8-263d61d4f983 on hv-cinder-82869 Sep 09 15:07:05.093430 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-faab9006-dcb4-448d-9537-5541bc1030cc req-3c2f5e50-2cfb-4ced-a7bb-b8599131d61d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033679 Sep 09 15:07:05.094272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 514/1039] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:07:05.116377 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:05.125254 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d16d89e6-3859-4a76-9e37-0813b0e9517a tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1760 microversion: 2.1 time: 0.201578 Sep 09 15:07:05.129625 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 526/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:04 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1760 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 15:07:21.108903 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:21.109669 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=12 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:21.114876 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37d0467f-608b-4f6e-a0b5-96661e3d3849 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:07:21.117156 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37d0467f-608b-4f6e-a0b5-96661e3d3849 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:21.124059 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d0467f-608b-4f6e-a0b5-96661e3d3849 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:21.124543 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d0467f-608b-4f6e-a0b5-96661e3d3849 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:21.124980 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d0467f-608b-4f6e-a0b5-96661e3d3849 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:21.125705 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d0467f-608b-4f6e-a0b5-96661e3d3849 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:21.126164 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d0467f-608b-4f6e-a0b5-96661e3d3849 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:21.126590 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d0467f-608b-4f6e-a0b5-96661e3d3849 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:21.196589 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37d0467f-608b-4f6e-a0b5-96661e3d3849 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "POST /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/action" status: 202 len: 0 microversion: 2.1 time: 0.088938 Sep 09 15:07:21.197272 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 515/1041] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:07:21 2022] POST /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:07:21.205298 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:21.205911 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:21.209446 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:21.210085 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:21.211110 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 15:07:21.211296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Fri Sep 9 15:07:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 (ip 10.222.0.15) !!! Sep 09 15:07:21.216733 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:21.217234 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:21.217677 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:21.218376 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:21.218964 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:21.219247 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:21.697025 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:21.705091 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aaf18843-884b-4e30-b8c7-61ad0083b6f1 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1752 microversion: 2.1 time: 0.503644 Sep 09 15:07:21.705694 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 527/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:21 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1752 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:22.730266 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:22.730910 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:22.737132 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:22.737675 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:22.738119 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:22.738809 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:22.739893 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:22.740324 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:22.936906 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:22.945126 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-261f0c0d-681d-422e-93e9-ca31dbff4d86 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1757 microversion: 2.1 time: 0.219927 Sep 09 15:07:22.945723 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 516/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:22 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:23.968636 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:23.969313 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:23.976683 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:23.977175 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:23.977708 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:23.978404 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:23.978856 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:23.979280 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:24.212211 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:24.220394 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-218c5334-ea60-41d1-b567-60848cd2921b tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1757 microversion: 2.1 time: 0.256439 Sep 09 15:07:24.220971 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 528/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:23 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:25.244730 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:25.245378 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:25.251835 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:25.252319 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:25.252761 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:25.253487 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:25.253952 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:25.254382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:25.393240 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:25.401837 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4a3ff664-c40f-4f85-94be-587d62d0cfb9 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1757 microversion: 2.1 time: 0.161194 Sep 09 15:07:25.402391 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 517/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:25 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:26.425890 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:26.426624 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:26.433431 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:26.433913 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:26.434351 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:26.435029 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:26.435476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:26.435896 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:26.576033 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:26.584746 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8dcd036-0797-4763-88ee-84e6743f0e70 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1757 microversion: 2.1 time: 0.162722 Sep 09 15:07:26.585322 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 529/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:26 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:27.607568 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:27.608183 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:27.615236 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:27.615723 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:27.616161 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:27.616868 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:27.617355 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:27.617788 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:27.768179 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:27.781487 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bb98ed87-cccb-4694-a2d0-6d11e403cb15 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1757 microversion: 2.1 time: 0.173380 Sep 09 15:07:27.782109 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 518/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:27 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:28.806439 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:28.806975 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:28.813509 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:28.813984 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:28.814415 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:28.815094 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:28.815540 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:28.815955 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:28.953837 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:28.961982 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-01eff1a0-63a6-472c-aa38-9951713cf2d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1757 microversion: 2.1 time: 0.159531 Sep 09 15:07:28.962551 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 530/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:28 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:29.985600 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:29.986270 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:29.993138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:29.993648 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:29.994089 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:29.994779 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:29.995233 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:29.995658 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:30.139494 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:30.147698 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a22b440e-606d-431c-814f-74e98a8c13b8 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1757 microversion: 2.1 time: 0.165997 Sep 09 15:07:30.148259 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 519/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:29 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:31.171511 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:31.172122 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:31.179203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:31.179689 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:31.180122 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:31.180808 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:31.181289 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:31.181897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:31.319343 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:31.327406 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed15612a-3758-45fc-96e2-f1e6764590fa tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1757 microversion: 2.1 time: 0.159780 Sep 09 15:07:31.327981 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 531/1050] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:31 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:32.351138 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:32.351808 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:32.358325 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:32.358836 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:32.359258 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:32.359942 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:32.360394 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:32.360812 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:32.506116 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:32.514274 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88c7f9ea-c1a4-4904-a429-212f144a26ed tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1757 microversion: 2.1 time: 0.167047 Sep 09 15:07:32.514830 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 520/1051] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:32 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:07:33.537425 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:07:33.538032 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:07:33.544049 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:33.544528 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:33.544955 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:33.545688 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:07:33.546136 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:07:33.546575 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:07:33.685733 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:07:33.694452 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61b25232-9ded-4034-a924-61bfab407934 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1760 microversion: 2.1 time: 0.161209 Sep 09 15:07:33.695014 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 532/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:07:33 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1760 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:06.087513 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2138769378"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:08:06.088080 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:06.090386 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=12 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:06.091031 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:06.097091 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:06.097598 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:06.098033 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:06.098723 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:06.099176 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:06.099598 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:06.226777 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.network.security_group_api [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Removing security group 92310644-556d-4b4c-95bf-8bf9e31e6b85 from port 92661755-b8dc-4b7c-99d8-a069f1628575 Sep 09 15:08:06.531410 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a716dde6-c710-4953-9bbc-280060de4889 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "POST /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/action" status: 202 len: 0 microversion: 2.1 time: 0.447641 Sep 09 15:08:06.532383 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 521/1053] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 15:08:06 2022] POST /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:08:06.558751 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=12 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:06.559544 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=36 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:06.621644 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c48d80ea-3c22-4ca8-b88c-edae490600db req-b58169d7-7079-42de-b79f-462dcf16bd10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db254b5c-e7fd-4f78-85a8-263d61d4f983", "tag": "92661755-b8dc-4b7c-99d8-a069f1628575"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:08:06.631907 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c48d80ea-3c22-4ca8-b88c-edae490600db req-b58169d7-7079-42de-b79f-462dcf16bd10 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:06.632405 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c48d80ea-3c22-4ca8-b88c-edae490600db req-b58169d7-7079-42de-b79f-462dcf16bd10 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:06.632840 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c48d80ea-3c22-4ca8-b88c-edae490600db req-b58169d7-7079-42de-b79f-462dcf16bd10 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:06.644749 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c48d80ea-3c22-4ca8-b88c-edae490600db req-b58169d7-7079-42de-b79f-462dcf16bd10 service nova] Creating event network-changed:92661755-b8dc-4b7c-99d8-a069f1628575 for instance db254b5c-e7fd-4f78-85a8-263d61d4f983 on hv-cinder-82869 Sep 09 15:08:06.651884 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c48d80ea-3c22-4ca8-b88c-edae490600db req-b58169d7-7079-42de-b79f-462dcf16bd10 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113322 Sep 09 15:08:06.652808 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 533/1054] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:08:07.592166 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:07.593246 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:07.600036 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:07.600709 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:07.601149 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:07.601868 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:07.602520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:07.603438 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:07.654089 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-a2aa8eec-3cfc-46a1-be5d-1953c594d3f9 req-8c36a7a3-10d7-4af0-b66b-c6d78ec3d80d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db254b5c-e7fd-4f78-85a8-263d61d4f983", "tag": "92661755-b8dc-4b7c-99d8-a069f1628575"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:08:07.667466 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-a2aa8eec-3cfc-46a1-be5d-1953c594d3f9 req-8c36a7a3-10d7-4af0-b66b-c6d78ec3d80d service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:07.667961 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-a2aa8eec-3cfc-46a1-be5d-1953c594d3f9 req-8c36a7a3-10d7-4af0-b66b-c6d78ec3d80d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:07.668659 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-a2aa8eec-3cfc-46a1-be5d-1953c594d3f9 req-8c36a7a3-10d7-4af0-b66b-c6d78ec3d80d service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:07.683005 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-a2aa8eec-3cfc-46a1-be5d-1953c594d3f9 req-8c36a7a3-10d7-4af0-b66b-c6d78ec3d80d service nova] Creating event network-changed:92661755-b8dc-4b7c-99d8-a069f1628575 for instance db254b5c-e7fd-4f78-85a8-263d61d4f983 on hv-cinder-82869 Sep 09 15:08:07.688223 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-a2aa8eec-3cfc-46a1-be5d-1953c594d3f9 req-8c36a7a3-10d7-4af0-b66b-c6d78ec3d80d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098123 Sep 09 15:08:07.689330 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 534/1055] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:08:07.693963 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lazy-loading 'services' on Instance uuid db254b5c-e7fd-4f78-85a8-263d61d4f983 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:08:07.772668 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5655944c-5475-41bf-95be-750b7b822cdf tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments/97fe0c49-8dd0-40b2-8281-7c7fa2171d0b" status: 202 len: 0 microversion: 2.1 time: 0.184721 Sep 09 15:08:07.784574 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db73df71-6644-49c4-be66-a6f793bc7b8f tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:07.785302 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 522/1056] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:08:07 2022] DELETE /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments/97fe0c49-8dd0-40b2-8281-7c7fa2171d0b => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:08:07.788034 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db73df71-6644-49c4-be66-a6f793bc7b8f tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:07.797068 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db73df71-6644-49c4-be66-a6f793bc7b8f tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:07.797582 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db73df71-6644-49c4-be66-a6f793bc7b8f tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:07.798014 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db73df71-6644-49c4-be66-a6f793bc7b8f tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:07.798714 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db73df71-6644-49c4-be66-a6f793bc7b8f tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:07.799547 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db73df71-6644-49c4-be66-a6f793bc7b8f tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:07.800155 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db73df71-6644-49c4-be66-a6f793bc7b8f tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:07.838768 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db73df71-6644-49c4-be66-a6f793bc7b8f tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060075 Sep 09 15:08:07.839440 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 535/1057] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:08:07 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:08:08.853312 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-027e131e-f740-48c8-bfe7-47f618fb26d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:08.855619 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-027e131e-f740-48c8-bfe7-47f618fb26d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:08.861814 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-027e131e-f740-48c8-bfe7-47f618fb26d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:08.862299 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-027e131e-f740-48c8-bfe7-47f618fb26d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:08.862734 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-027e131e-f740-48c8-bfe7-47f618fb26d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:08.863426 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-027e131e-f740-48c8-bfe7-47f618fb26d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:08.863881 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-027e131e-f740-48c8-bfe7-47f618fb26d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:08.864798 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-027e131e-f740-48c8-bfe7-47f618fb26d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:08.892887 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-027e131e-f740-48c8-bfe7-47f618fb26d4 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044464 Sep 09 15:08:08.893459 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 523/1058] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 15:08:08 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 15:08:08.904794 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:08.905500 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:08.912074 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:08.912550 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:08.912979 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:08.913685 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:08.914132 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:08.914551 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:08.987148 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] HTTP exception thrown: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 is not attached to volume 97fe0c49-8dd0-40b2-8281-7c7fa2171d0b Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Request method failure captured: Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments/97fe0c49-8dd0-40b2-8281-7c7fa2171d0b HTTP/1.1 Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1ZhL5_a6j25tBxdlo8g1keywK1aew4hfxa2uE1Q7TwiW7yKps5akjZNp4VZUNa9_cz-jaFTFkB8Vy2cQf9PouQZwwmul_PaBxAogDhXXLlAXNRGh1Syc8PeH--DzWYpO8vlLK2htMB_feyYRBW0-Zc0gY97sIFgJO-z4cG_LFZtsu8 Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: ee3a90f56942438a887a45157622532f Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-TestMinimumBasicScenario-196882853 Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:08:08.990048 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ee3a90f56942438a887a45157622532f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ee3a90f56942438a887a45157622532f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ee3a90f56942438a887a45157622532f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ee3a90f56942438a887a45157622532f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-TestMinimumBasicScenario-196882853 Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: ee3a90f56942438a887a45157622532f Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-TestMinimumBasicScenario-196882853 Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-TestMinimumBasicScenario-196882853-project Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: a0c64b4ade2e4fdda31999e89e307980 Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-TestMinimumBasicScenario-196882853-project Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:08:08.991835 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 is not attached to volume 97fe0c49-8dd0-40b2-8281-7c7fa2171d0b Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'server_id': 'db254b5c-e7fd-4f78-85a8-263d61d4f983', 'id': '97fe0c49-8dd0-40b2-8281-7c7fa2171d0b'} Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 97fe0c49-8dd0-40b2-8281-7c7fa2171d0b. Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:08:08.992785 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 is not attached to volume 97fe0c49-8dd0-40b2-8281-7c7fa2171d0b Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 is not attached to volume 97fe0c49-8dd0-40b2-8281-7c7fa2171d0b Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:08.994443 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Returning 404 to user: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 is not attached to volume 97fe0c49-8dd0-40b2-8281-7c7fa2171d0b {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:08:08.995666 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e69732be-a1f9-4c32-96c9-c75faceba644 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments/97fe0c49-8dd0-40b2-8281-7c7fa2171d0b" status: 404 len: 154 microversion: 2.1 time: 0.091552 Sep 09 15:08:08.995666 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 536/1059] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 15:08:08 2022] DELETE /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983/os-volume_attachments/97fe0c49-8dd0-40b2-8281-7c7fa2171d0b => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:08:10.302885 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:10.303382 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:10.309858 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:10.310345 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:10.310785 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:10.311477 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:10.311935 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:10.312363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:10.337363 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:08:10.412865 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f12fd39b-b007-4d62-b1d8-8f54b4f61987 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 204 len: 0 microversion: 2.1 time: 0.113971 Sep 09 15:08:10.413733 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 524/1060] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:08:10 2022] DELETE /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:08:10.421606 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:10.422219 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:10.429313 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:10.429797 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:10.430234 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:10.430923 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:10.431382 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:10.431804 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:10.564069 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:08:10.572342 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-441424ab-6f3d-469a-848f-b2c4a1a70021 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1555 microversion: 2.1 time: 0.154601 Sep 09 15:08:10.572902 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 537/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:10 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:11.595989 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:11.596614 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:11.602959 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:11.603436 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:11.603869 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:11.604553 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:11.605004 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:11.605448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:11.734274 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:08:11.741989 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48817f90-8db4-465b-a5f8-4181eb900b48 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1555 microversion: 2.1 time: 0.150291 Sep 09 15:08:11.742561 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 525/1062] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:11 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:12.490062 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-77cd58af-97ce-4d8d-a4be-4c37da65a6f5 req-4225c398-9f76-43d7-9f1e-f3507e3f734e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db254b5c-e7fd-4f78-85a8-263d61d4f983", "name": "network-vif-deleted", "tag": "92661755-b8dc-4b7c-99d8-a069f1628575"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:08:12.503527 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-77cd58af-97ce-4d8d-a4be-4c37da65a6f5 req-4225c398-9f76-43d7-9f1e-f3507e3f734e service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:12.504011 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-77cd58af-97ce-4d8d-a4be-4c37da65a6f5 req-4225c398-9f76-43d7-9f1e-f3507e3f734e service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:12.504444 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-77cd58af-97ce-4d8d-a4be-4c37da65a6f5 req-4225c398-9f76-43d7-9f1e-f3507e3f734e service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:12.515993 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-77cd58af-97ce-4d8d-a4be-4c37da65a6f5 req-4225c398-9f76-43d7-9f1e-f3507e3f734e service nova] Creating event network-vif-deleted:92661755-b8dc-4b7c-99d8-a069f1628575 for instance db254b5c-e7fd-4f78-85a8-263d61d4f983 on hv-cinder-82869 Sep 09 15:08:12.520757 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-77cd58af-97ce-4d8d-a4be-4c37da65a6f5 req-4225c398-9f76-43d7-9f1e-f3507e3f734e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035053 Sep 09 15:08:12.521360 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 538/1063] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:08:12.765675 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:12.766351 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:12.773620 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:12.774042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:12.774515 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:12.775230 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:12.775697 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:12.776126 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:12.810932 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:12.811423 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:12.811863 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:12.812318 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lazy-loading 'fault' on Instance uuid db254b5c-e7fd-4f78-85a8-263d61d4f983 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:08:12.854965 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c64b4ade2e4fdda31999e89e307980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a90f56942438a887a45157622532f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:08:12.863126 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e42a732-bdfa-4720-81ab-c6979078bb7c tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 200 len: 1349 microversion: 2.1 time: 0.101386 Sep 09 15:08:12.864017 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 526/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:12 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:13.886557 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:13.887299 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] [instance: db254b5c-e7fd-4f78-85a8-263d61d4f983] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:13.893428 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:13.893915 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:13.894347 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:13.895027 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:13.895476 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:13.895897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:13.908987 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] HTTP exception thrown: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 could not be found. Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Request method failure captured: Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 HTTP/1.1 Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1ZhL5_a6j25tBxdlo8g1keywK1aew4hfxa2uE1Q7TwiW7yKps5akjZNp4VZUNa9_cz-jaFTFkB8Vy2cQf9PouQZwwmul_PaBxAogDhXXLlAXNRGh1Syc8PeH--DzWYpO8vlLK2htMB_feyYRBW0-Zc0gY97sIFgJO-z4cG_LFZtsu8 Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: ee3a90f56942438a887a45157622532f Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-TestMinimumBasicScenario-196882853 Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:08:13.911116 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ee3a90f56942438a887a45157622532f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ee3a90f56942438a887a45157622532f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ee3a90f56942438a887a45157622532f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ee3a90f56942438a887a45157622532f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-TestMinimumBasicScenario-196882853 Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: ee3a90f56942438a887a45157622532f Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-TestMinimumBasicScenario-196882853 Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-TestMinimumBasicScenario-196882853-project Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: a0c64b4ade2e4fdda31999e89e307980 Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-TestMinimumBasicScenario-196882853-project Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 could not be found. Sep 09 15:08:13.912671 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': 'db254b5c-e7fd-4f78-85a8-263d61d4f983'} Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 could not be found. Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:08:13.913602 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 could not be found. Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 could not be found. Sep 09 15:08:13.915203 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:13.916767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Returning 404 to user: Instance db254b5c-e7fd-4f78-85a8-263d61d4f983 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:08:13.916767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ecbc693-4527-41e5-9820-662f278a8b8e tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983" status: 404 len: 111 microversion: 2.1 time: 0.030563 Sep 09 15:08:13.916767 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 539/1065] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:13 2022] GET /compute/v2.1/servers/db254b5c-e7fd-4f78-85a8-263d61d4f983 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:08:13.921246 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d5e5ade2-e20c-42fb-8fd2-d99494b1c687 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] Calling method '.version_select at 0x7f8ad275b280>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:13.941029 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d5e5ade2-e20c-42fb-8fd2-d99494b1c687 tempest-TestMinimumBasicScenario-196882853 tempest-TestMinimumBasicScenario-196882853-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1418068583" status: 202 len: 0 microversion: 2.1 time: 0.023851 Sep 09 15:08:13.941608 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 527/1066] 10.222.0.15 () {58 vars in 1272 bytes} [Fri Sep 9 15:08:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1418068583 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 15:08:16.516952 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:16.517457 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:16.532763 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-3fefe9dc-c034-47d4-bd97-920e1f54f934 req-a4072f9a-6ca4-4c5b-bed3-53f5409998a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba28ee63-2458-4bd0-9e99-e6723db42836", "tag": "6bfea242-79c3-46c1-8ac9-c52dba84bb9f"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:08:16.550904 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:16.552334 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:16.553829 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:16.554771 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:16.557947 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:16.558585 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:16.562268 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-3fefe9dc-c034-47d4-bd97-920e1f54f934 req-a4072f9a-6ca4-4c5b-bed3-53f5409998a5 service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:16.566534 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-3fefe9dc-c034-47d4-bd97-920e1f54f934 req-a4072f9a-6ca4-4c5b-bed3-53f5409998a5 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:16.568664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-3fefe9dc-c034-47d4-bd97-920e1f54f934 req-a4072f9a-6ca4-4c5b-bed3-53f5409998a5 service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:16.589152 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-3fefe9dc-c034-47d4-bd97-920e1f54f934 req-a4072f9a-6ca4-4c5b-bed3-53f5409998a5 service nova] Creating event network-changed:6bfea242-79c3-46c1-8ac9-c52dba84bb9f for instance ba28ee63-2458-4bd0-9e99-e6723db42836 on hv-cinder-82869 Sep 09 15:08:16.604488 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-3fefe9dc-c034-47d4-bd97-920e1f54f934 req-a4072f9a-6ca4-4c5b-bed3-53f5409998a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078302 Sep 09 15:08:16.604983 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 528/1067] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:08:16.613472 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:08:16.735604 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8247cc2-2834-4849-b20f-3ea34fe9487b tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 204 len: 0 microversion: 2.1 time: 0.222530 Sep 09 15:08:16.736636 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 540/1068] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:08:16 2022] DELETE /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:08:16.746717 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:16.747678 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:16.755291 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:16.756039 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:16.756649 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:16.757587 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:16.758209 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:16.758811 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:16.928407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:08:16.936609 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8e651a28-732b-45af-8dad-39f012b2ff67 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1576 microversion: 2.1 time: 0.194679 Sep 09 15:08:16.937286 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 529/1069] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:16 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:17.960957 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:17.961897 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:17.968406 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:17.968899 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:17.969591 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:17.970232 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:17.970794 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:17.971281 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:18.260894 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:08:18.268713 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46308132-0aa9-4fb8-aa25-22b77859e551 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1576 microversion: 2.1 time: 0.312500 Sep 09 15:08:18.269296 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 541/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:17 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1576 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:18.941407 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-51d57e01-eab2-4ed2-89f9-a253470f5570 req-2e15fa86-9f0c-4362-a8e8-f51b0ec89f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba28ee63-2458-4bd0-9e99-e6723db42836", "name": "network-vif-deleted", "tag": "6bfea242-79c3-46c1-8ac9-c52dba84bb9f"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:08:18.958502 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-51d57e01-eab2-4ed2-89f9-a253470f5570 req-2e15fa86-9f0c-4362-a8e8-f51b0ec89f3a service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:18.959015 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-51d57e01-eab2-4ed2-89f9-a253470f5570 req-2e15fa86-9f0c-4362-a8e8-f51b0ec89f3a service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:18.959437 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-51d57e01-eab2-4ed2-89f9-a253470f5570 req-2e15fa86-9f0c-4362-a8e8-f51b0ec89f3a service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:18.971885 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-51d57e01-eab2-4ed2-89f9-a253470f5570 req-2e15fa86-9f0c-4362-a8e8-f51b0ec89f3a service nova] Creating event network-vif-deleted:6bfea242-79c3-46c1-8ac9-c52dba84bb9f for instance ba28ee63-2458-4bd0-9e99-e6723db42836 on hv-cinder-82869 Sep 09 15:08:18.978526 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-51d57e01-eab2-4ed2-89f9-a253470f5570 req-2e15fa86-9f0c-4362-a8e8-f51b0ec89f3a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041106 Sep 09 15:08:18.979135 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 530/1071] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:08:19.292607 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:19.293253 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:19.306256 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:19.306916 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:19.310791 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:19.313489 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:19.314064 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:19.314513 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:19.366635 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:19.367445 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:19.367890 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:19.368339 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lazy-loading 'fault' on Instance uuid ba28ee63-2458-4bd0-9e99-e6723db42836 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:08:19.428420 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:08:19.437717 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-523c9a0b-87f6-41be-af3d-f8a1800eee62 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 200 len: 1229 microversion: 2.1 time: 0.148829 Sep 09 15:08:19.438561 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 542/1072] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:19 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 1229 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:20.462213 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:20.462922 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ba28ee63-2458-4bd0-9e99-e6723db42836] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:20.469010 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:20.469520 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:20.469966 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:20.470664 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:20.471126 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:20.471555 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:20.490294 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] HTTP exception thrown: Instance ba28ee63-2458-4bd0-9e99-e6723db42836 could not be found. Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Request method failure captured: Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 HTTP/1.1 Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1UsZxE_48khTRIo_vdRab-4obgYjM0XRBX6EQx6g8XpIxEu0EFcPBga0AVgLyluKvsWLNhG8eGi7hipCB9nWvGu4UCDadpSAuNbsu3OwVfFJei6IhiBhk7GCahmWjgULqQeXRMUO-RNNQpDynLAE3_idjFD2b-0XKBslng9QWAKZ10 Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:08:20.492073 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_515d1ca3dcd249ada56b21a0a6e3a5b9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 9a50fbbf18584bb1a784283e768be7a2 Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance ba28ee63-2458-4bd0-9e99-e6723db42836 could not be found. Sep 09 15:08:20.493958 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': 'ba28ee63-2458-4bd0-9e99-e6723db42836'} Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba28ee63-2458-4bd0-9e99-e6723db42836 could not be found. Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:08:20.495155 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba28ee63-2458-4bd0-9e99-e6723db42836 could not be found. Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba28ee63-2458-4bd0-9e99-e6723db42836 could not be found. Sep 09 15:08:20.496637 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:20.498531 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Returning 404 to user: Instance ba28ee63-2458-4bd0-9e99-e6723db42836 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:08:20.498531 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-643b1d07-7274-4821-90d5-39215ac31d7d tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836" status: 404 len: 111 microversion: 2.1 time: 0.036348 Sep 09 15:08:20.498531 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 531/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:20 2022] GET /compute/v2.1/servers/ba28ee63-2458-4bd0-9e99-e6723db42836 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:08:23.558539 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-bd638ab1-71e6-4e5c-bc1c-a1201830ec76 req-04455e5c-8d06-493c-a640-91eff5d2761b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc366a9-fbb3-4d0c-a66f-05263ec7fadf", "tag": "cdbce435-f10d-40e7-9b00-ad1252f28480"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:08:23.563562 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:23.564058 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:23.571396 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:23.571903 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:23.572424 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:23.573166 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:23.573875 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:23.574310 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:23.574472 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-bd638ab1-71e6-4e5c-bc1c-a1201830ec76 req-04455e5c-8d06-493c-a640-91eff5d2761b service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:23.575154 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-bd638ab1-71e6-4e5c-bc1c-a1201830ec76 req-04455e5c-8d06-493c-a640-91eff5d2761b service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:23.575588 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-bd638ab1-71e6-4e5c-bc1c-a1201830ec76 req-04455e5c-8d06-493c-a640-91eff5d2761b service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:23.586727 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-bd638ab1-71e6-4e5c-bc1c-a1201830ec76 req-04455e5c-8d06-493c-a640-91eff5d2761b service nova] Creating event network-changed:cdbce435-f10d-40e7-9b00-ad1252f28480 for instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf on hv-cinder-82869 Sep 09 15:08:23.591753 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-bd638ab1-71e6-4e5c-bc1c-a1201830ec76 req-04455e5c-8d06-493c-a640-91eff5d2761b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036753 Sep 09 15:08:23.592367 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 532/1074] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 15:08:23.602735 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 15:08:23.706539 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9d35db7-c0e5-4f63-9b34-706570daab27 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 204 len: 0 microversion: 2.1 time: 0.154073 Sep 09 15:08:23.707934 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 543/1075] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:08:23 2022] DELETE /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 15:08:23.720145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:23.721361 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:23.728773 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:23.729938 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:23.730585 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:23.731290 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:23.731745 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:23.732173 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:23.868569 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:08:23.876294 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0d387408-f8d9-4e94-a7d3-5e0e4a9903c1 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1578 microversion: 2.1 time: 0.161342 Sep 09 15:08:23.877001 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 533/1076] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:23 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:24.899831 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:24.900532 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:24.906928 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:24.907412 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:24.907846 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:24.908795 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:24.909357 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:24.909784 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:25.120444 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:08:25.128792 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c2bdf05-703c-442f-8c21-b7f46eb0620f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1578 microversion: 2.1 time: 0.233215 Sep 09 15:08:25.129522 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 544/1077] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:24 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:25.863042 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-44c15821-ada6-4958-be26-6926b1dba4fe req-b56ff1f5-b2ec-4053-8f69-f456ea32cdda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc366a9-fbb3-4d0c-a66f-05263ec7fadf", "name": "network-vif-deleted", "tag": "cdbce435-f10d-40e7-9b00-ad1252f28480"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 15:08:25.873468 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-44c15821-ada6-4958-be26-6926b1dba4fe req-b56ff1f5-b2ec-4053-8f69-f456ea32cdda service nova] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:25.874034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-44c15821-ada6-4958-be26-6926b1dba4fe req-b56ff1f5-b2ec-4053-8f69-f456ea32cdda service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:25.874714 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-44c15821-ada6-4958-be26-6926b1dba4fe req-b56ff1f5-b2ec-4053-8f69-f456ea32cdda service nova] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:25.886763 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-44c15821-ada6-4958-be26-6926b1dba4fe req-b56ff1f5-b2ec-4053-8f69-f456ea32cdda service nova] Creating event network-vif-deleted:cdbce435-f10d-40e7-9b00-ad1252f28480 for instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf on hv-cinder-82869 Sep 09 15:08:25.891542 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-44c15821-ada6-4958-be26-6926b1dba4fe req-b56ff1f5-b2ec-4053-8f69-f456ea32cdda service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032262 Sep 09 15:08:25.892145 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 534/1078] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 15:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 15:08:26.154615 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:26.155238 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:26.162532 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:26.163026 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:26.163662 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:26.164373 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:26.164995 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:26.176397 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:26.224471 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:26.224824 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:26.225300 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:26.225753 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lazy-loading 'fault' on Instance uuid 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 15:08:26.268162 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a50fbbf18584bb1a784283e768be7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515d1ca3dcd249ada56b21a0a6e3a5b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 15:08:26.276095 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c9018b2-a085-4cae-97e9-11828c0cc73f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 200 len: 1230 microversion: 2.1 time: 0.125412 Sep 09 15:08:26.276682 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 545/1079] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:26 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 1230 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 15:08:27.300113 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:27.300802 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:27.306987 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:27.307475 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:27.307917 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:27.308604 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:27.309061 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:27.309530 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:27.323034 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] HTTP exception thrown: Instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf could not be found. Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Request method failure captured: Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf HTTP/1.1 Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1UsZxE_48khTRIo_vdRab-4obgYjM0XRBX6EQx6g8XpIxEu0EFcPBga0AVgLyluKvsWLNhG8eGi7hipCB9nWvGu4UCDadpSAuNbsu3OwVfFJei6IhiBhk7GCahmWjgULqQeXRMUO-RNNQpDynLAE3_idjFD2b-0XKBslng9QWAKZ10 Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:08:27.324666 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_515d1ca3dcd249ada56b21a0a6e3a5b9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 9a50fbbf18584bb1a784283e768be7a2 Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf could not be found. Sep 09 15:08:27.326384 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': '1dc366a9-fbb3-4d0c-a66f-05263ec7fadf'} Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf could not be found. Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:08:27.327311 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf could not be found. Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf could not be found. Sep 09 15:08:27.328853 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.330305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Returning 404 to user: Instance 1dc366a9-fbb3-4d0c-a66f-05263ec7fadf could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:08:27.330305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9acf56a3-bf5e-4273-b6cb-66013116ef6f tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf" status: 404 len: 111 microversion: 2.1 time: 0.030901 Sep 09 15:08:27.330305 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 535/1080] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:27 2022] GET /compute/v2.1/servers/1dc366a9-fbb3-4d0c-a66f-05263ec7fadf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:08:27.760104 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:27.760648 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:27.767117 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:27.767599 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:27.768036 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:27.768720 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:27.769185 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:27.769639 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:27.782649 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] HTTP exception thrown: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Request method failure captured: Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 HTTP/1.1 Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Connection: close Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Host: 10.222.0.15 Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjG1UsZxE_48khTRIo_vdRab-4obgYjM0XRBX6EQx6g8XpIxEu0EFcPBga0AVgLyluKvsWLNhG8eGi7hipCB9nWvGu4UCDadpSAuNbsu3OwVfFJei6IhiBhk7GCahmWjgULqQeXRMUO-RNNQpDynLAE3_idjFD2b-0XKBslng9QWAKZ10 Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 09 15:08:27.784656 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_515d1ca3dcd249ada56b21a0a6e3a5b9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Id: 9a50fbbf18584bb1a784283e768be7a2 Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: method: > Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: exception: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.786380 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: action_args: {'id': 'ffad6426-5a0d-4119-9cd7-c60407cc7972'} Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:08:27.787263 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.790579 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.792207 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Returning 404 to user: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:08:27.792207 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-52800e61-8059-4b22-8773-03c189fd1ba4 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 404 len: 111 microversion: 2.1 time: 0.029810 Sep 09 15:08:27.792207 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 546/1081] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 15:08:27 2022] DELETE /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:08:27.794791 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:27.795404 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] [instance: ffad6426-5a0d-4119-9cd7-c60407cc7972] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 15:08:27.801838 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:27.802319 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:27.802754 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:27.803444 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Acquiring lock "14f5c374-113e-49b8-9575-27f7b8860d4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 15:08:27.803904 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 15:08:27.804327 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Lock "14f5c374-113e-49b8-9575-27f7b8860d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 15:08:27.817900 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] HTTP exception thrown: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Request method failure captured: Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 HTTP/1.1 Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Connection: close Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Host: 10.222.0.15 Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjG1UsZxE_48khTRIo_vdRab-4obgYjM0XRBX6EQx6g8XpIxEu0EFcPBga0AVgLyluKvsWLNhG8eGi7hipCB9nWvGu4UCDadpSAuNbsu3OwVfFJei6IhiBhk7GCahmWjgULqQeXRMUO-RNNQpDynLAE3_idjFD2b-0XKBslng9QWAKZ10 Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Role: reader,member Sep 09 15:08:27.819448 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Roles: reader,member Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/515d1ca3dcd249ada56b21a0a6e3a5b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_515d1ca3dcd249ada56b21a0a6e3a5b9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 515d1ca3dcd249ada56b21a0a6e3a5b9 Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1590549425 Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Id: 9a50fbbf18584bb1a784283e768be7a2 Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-TestVolumeBootPattern-1590549425-project Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: method: > Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: exception: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.821190 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: action_args: {'id': 'ffad6426-5a0d-4119-9cd7-c60407cc7972'} Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 15:08:27.822105 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. Sep 09 15:08:27.823528 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 09 15:08:27.825033 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Returning 404 to user: Instance ffad6426-5a0d-4119-9cd7-c60407cc7972 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 15:08:27.825033 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5678c1eb-90f5-4335-95a6-5a766b41e464 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972" status: 404 len: 111 microversion: 2.1 time: 0.031445 Sep 09 15:08:27.825033 dv-cinder-828696-11-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 536/1082] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 15:08:27 2022] GET /compute/v2.1/servers/ffad6426-5a0d-4119-9cd7-c60407cc7972 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 15:08:29.118370 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5fa8a5ef-a880-4f15-a9e8-af3c7aaf8058 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] Calling method '.version_select at 0x7f8ad27da790>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 15:08:29.143643 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5fa8a5ef-a880-4f15-a9e8-af3c7aaf8058 tempest-TestVolumeBootPattern-1590549425 tempest-TestVolumeBootPattern-1590549425-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-845692317" status: 202 len: 0 microversion: 2.1 time: 0.029098 Sep 09 15:08:29.144805 dv-cinder-828696-11-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 547/1083] 10.222.0.15 () {58 vars in 1260 bytes} [Fri Sep 9 15:08:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-845692317 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)